Sep 28 18:00:57 devstack cinder-volume[75753]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:00:57 devstack cinder-volume[75753]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:00:57 devstack cinder-volume[75753]: we strongly recommend against using it for new projects. Sep 28 18:00:57 devstack cinder-volume[75753]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:00:57 devstack cinder-volume[75753]: framework. For more detail see Sep 28 18:00:57 devstack cinder-volume[75753]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:00:57 devstack cinder-volume[75753]: import eventlet # noqa Sep 28 18:01:00 devstack cinder-volume[75753]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:01:00 devstack cinder-volume[75753]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:01:00 devstack cinder-volume[75753]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:01:01 devstack cinder-volume[75753]: INFO dbcounter [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Registered counter for database cinder Sep 28 18:01:01 devstack cinder-volume[75753]: DEBUG oslo_db.sqlalchemy.engines [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:01 devstack cinder-volume[75753]: DEBUG dbcounter [-] [75753] Writer thread running {{(pid=75753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:01:01 devstack cinder-volume[75753]: INFO cinder.rpc [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:01:01 devstack cinder-volume[75753]: INFO cinder.rpc [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:01:01 devstack cinder-volume[75753]: DEBUG oslo_db.sqlalchemy.engines [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:01 devstack cinder-volume[75753]: INFO cinder.volume.manager [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Determined volume DB was empty at startup. Sep 28 18:01:01 devstack cinder-volume[75753]: DEBUG cinder.volume.manager [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75753) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:01:01 devstack cinder-volume[75753]: INFO cinder.volume.manager [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 18:01:01 devstack cinder-volume[75753]: WARNING stevedore.named [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:01:01 devstack cinder-volume[75753]: WARNING castellan.key_manager [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:01:01 devstack cinder-volume[75753]: WARNING cinder.keymgr.conf_key_mgr [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:01:01 devstack cinder-volume[75753]: DEBUG cinder.volume.drivers.lvm [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75753) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 18:01:01 devstack cinder-volume[75753]: DEBUG oslo_concurrency.processutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_concurrency.processutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] CMD "cinder-rtstool verify" returned: 0 in 0.481s {{(pid=75753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_db.sqlalchemy.engines [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:02 devstack cinder-volume[75753]: INFO cinder.rpc [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 18:01:02 devstack cinder-volume[75753]: INFO cinder.rpc [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 18:01:02 devstack cinder-volume[75753]: WARNING stevedore.named [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:01:02 devstack cinder-volume[75753]: WARNING castellan.key_manager [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:01:02 devstack cinder-volume[75753]: INFO cinder.volume.manager [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_db.sqlalchemy.engines [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:02 devstack cinder-volume[75753]: INFO oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Starting 1 workers Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Started child 75916 {{(pid=75753) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Full set of CONF: {{(pid=75753) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] ******************************************************************************** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Configuration options gathered from: {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] ================================================================================ {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] allow_availability_zone_fallback = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] allow_compression_on_image_upload = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] allowed_direct_url_schemes = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] api_rate_limit = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] auth_strategy = keystone {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] az_cache_duration = 3600 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_availability_zone = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_host = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_stats_polling_interval = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backup_api_class = cinder.backup.api.API {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backup_name_template = backup-%s {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backup_use_same_host = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backup_use_temp_snapshot = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] chap_password = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75916]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] chap_username = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_internal_tenant_project_id = 8b207ed08d84412599c34dde72c037eb {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_internal_tenant_user_id = 0320533558ff4906b33ccd384845cc5d {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cloned_volume_same_az = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cluster = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] compression_format = gzip {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] compute_api_class = cinder.compute.nova.API {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] config_dir = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] config_source = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] control_exchange = openstack {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] debug = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] default_availability_zone = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] default_group_type = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] default_volume_type = lvmdriver-1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] disk_geometry = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] driver_client_cert = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] driver_client_cert_key = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] driver_data_namespace = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] driver_ssl_cert_path = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] driver_ssl_cert_verify = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] driver_use_ssl = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] enable_force_upload = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] enable_new_services = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] enable_unsupported_driver = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] enforce_multipath_for_image_xfer = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] filter_function = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_api_insecure = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_api_ssl_compression = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_ca_certificates_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_catalog_info = image:glance:publicURL {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_num_retries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance_request_timeout = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] goodness_function = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] graceful_shutdown_timeout = 5 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] group_api_class = cinder.group.api.API {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] host = devstack {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_compress_on_upload = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_conversion_address_space_limit = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_conversion_cpu_limit = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_conversion_disable = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_introspection_address_space_limit = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_introspection_cpu_limit = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_upload_use_cinder_backend = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_upload_use_internal_tenant = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_volume_cache_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_volume_cache_max_count = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] image_volume_cache_max_size_gb = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] init_host_max_objects_retrieval = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] instance_format = [instance: %(uuid)s] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] iscsi_target_flags = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] iscsi_write_cache = on {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] iser_helper = tgtadm {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] iser_ip_address = 192.168.122.7 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] iser_port = 3260 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_color = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_config_append = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_dir = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_options = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_rotate_interval = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_rotate_interval_type = days {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] log_rotation_type = none {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] max_age = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] max_logfile_count = 30 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] max_logfile_size_mb = 200 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] max_over_subscription_ratio = 20.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] message_reap_interval = 86400 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] message_ttl = 2592000 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] migration_create_volume_timeout_secs = 300 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] monkey_patch = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] monkey_patch_modules = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] my_ip = 192.168.122.7 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] no_snapshot_gb_quota = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] num_iser_scan_tries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] num_shell_tries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] num_volume_device_scan_tries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] nvmeof_conn_info_version = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] nvmet_ns_id = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] nvmet_port_id = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] osapi_max_limit = 1000 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] osapi_volume_ext_list = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] osapi_volume_listen_port = 8776 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] osapi_volume_use_ssl = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] osapi_volume_workers = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] per_volume_size_limit = -1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] periodic_fuzzy_delay = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] periodic_interval = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] public_endpoint = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] publish_errors = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] quota_backup_gigabytes = 1000 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] quota_backups = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] quota_gigabytes = 1000 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] quota_groups = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] quota_snapshots = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] quota_volumes = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] rate_limit_burst = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] rate_limit_except_level = CRITICAL {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] rate_limit_interval = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] reinit_driver_count = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] replication_device = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] report_discard_supported = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] report_interval = 120 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] reservation_clean_interval = 86400 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] reservation_expire = 86400 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] reserved_image_namespaces = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] reserved_percentage = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] rpc_response_timeout = 120 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] run_external_periodic_tasks = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] scst_target_driver = iscsi {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] scst_target_iqn_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_down_time = 720 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] shell_completion = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] snapshot_name_template = snapshot-%s {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] snapshot_same_host = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] split_loggers = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] state_path = /opt/stack/data/cinder {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] storage_availability_zone = nova {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] storage_protocol = iSCSI {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] syslog_log_facility = LOG_USER {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] target_helper = lioadm {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] target_ip_address = 192.168.122.7 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] target_port = 3260 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] target_protocol = iscsi {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] target_secondary_ip_addresses = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] trace_flags = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] transport_url = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] until_refresh = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] use_chap_auth = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] use_default_quota_class = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] use_journal = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] use_json = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] use_multipath_for_image_xfer = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] use_stderr = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] use_syslog = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] verify_glance_signatures = enabled {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_api_class = cinder.volume.api.API {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_backend_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_clear = zero {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_clear_ionice = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_clear_size = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_copy_bps_limit = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_dd_blocksize = 1M {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_name_template = volume-%s {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_service_inithost_offload = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volume_usage_audit_period = month {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75916]: INFO cinder.volume.manager [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] zoning_mode = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:02 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_concurrency.disable_process_locking = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.auth_section = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.auth_type = password {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.auth_version = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.cache = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.include_service_catalog = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.insecure = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.interface = public {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_password = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcache_username = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.region_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.service_type = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.backend = dogpile.cache.null {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.backend_argument = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.backend_expiration_time = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.config_prefix = cache.oslo {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.debug_cache_backend = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.enable_retry_client = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.enable_socket_keepalive = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.expiration_time = 600 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.hashclient_retry_attempts = 2 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.memcache_dead_retry = 300 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.memcache_pool_maxsize = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.memcache_sasl_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.password = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.proxies = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.redis_db = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.redis_server = localhost:6379 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.retry_attempts = 2 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.retry_delay = 0.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.socket_keepalive_count = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.socket_keepalive_idle = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.socket_keepalive_interval = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.socket_timeout = 1.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.tls_allowed_ciphers = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.tls_cafile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.tls_certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.tls_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.tls_keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cache.username = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] coordination.backend_url = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.asyncio_connection = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.asyncio_slave_connection = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.backend = sqlalchemy {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.connection = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.connection_debug = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.connection_parameters = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.connection_recycle_time = 3600 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.connection_trace = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.db_inc_retry_interval = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.db_max_retries = 20 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.db_max_retry_interval = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.db_retry_interval = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.max_overflow = 50 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.max_pool_size = 5 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.max_retries = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.mysql_wsrep_sync_wait = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.pool_timeout = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.retry_interval = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.slave_connection = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.sqlite_synchronous = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.synchronous_reader = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] database.use_db_reconnect = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_tracing.insecure = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.connection_string = messaging:// {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.es_doc_type = notification {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.es_scroll_size = 10000 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.es_scroll_time = 2m {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.filter_error_trace = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.hmac_keys = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.sentinel_service_name = mymaster {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.socket_timeout = 0.1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.trace_requests = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler.trace_sqlalchemy = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler_jaeger.process_tags = {} {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler_jaeger.service_name_prefix = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] profiler_otlp.service_name_prefix = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.enforce_new_defaults = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.policy_default_rule = default {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.policy_file = policy.yaml {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] privsep_osbrick.group = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] privsep_osbrick.helper_command = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] privsep_osbrick.user = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_sys_admin.group = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_sys_admin.helper_command = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] cinder_sys_admin.user = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.auth_section = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.auth_type = password {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.cafile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.collect_timing = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.insecure = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.send_service_user_token = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.split_loggers = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.timeout = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.tls_ciphers = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] service_user.tls_min_version = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.auth_section = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.auth_type = password {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.collect_timing = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.insecure = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.region_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.split_loggers = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.timeout = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.tls_ciphers = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] glance.tls_min_version = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.backend_availability_zone = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.chap_password = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.chap_username = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.disk_geometry = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.driver_client_cert = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.driver_client_cert_key = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.driver_data_namespace = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.driver_use_ssl = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.extra_capabilities = {} {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.filter_function = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.goodness_function = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.iscsi_target_flags = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.iscsi_write_cache = on {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.iser_helper = tgtadm {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.iser_port = 3260 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.lvm_share_target = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.lvm_type = auto {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.num_shell_tries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.replication_device = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.report_discard_supported = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.reserved_percentage = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.target_helper = tgtadm {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.target_port = 3260 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.target_protocol = iscsi {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.trace_flags = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.unique_fqdn_network = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.use_chap_auth = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_backend_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_clear = zero {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_clear_ionice = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_clear_size = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_reports.file_event_handler = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_reports.log_dir = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.backend_host = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.chap_password = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.chap_username = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.disk_geometry = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.driver_client_cert = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.extra_capabilities = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.filter_function = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.goodness_function = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.iser_helper = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.iser_ip_address = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.iser_port = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.lvm_share_target = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.lvm_type = auto {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.num_shell_tries = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.replication_device = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.report_discard_supported = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.reserved_percentage = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.scst_target_driver = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.storage_protocol = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.target_helper = lioadm {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.target_ip_address = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.target_port = 3260 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.trace_flags = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.use_chap_auth = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_clear = zero {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_clear_size = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] lvmdriver-1.volumes_dir = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.ssl = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_notifications.driver = [] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_notifications.retry = -1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] key_manager.fixed_key = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.barbican_api_version = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.barbican_endpoint = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.barbican_endpoint_type = public {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.barbican_region_name = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.cafile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.collect_timing = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.insecure = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.number_of_retries = 60 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.retry_delay = 1 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.send_service_user_token = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.split_loggers = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.timeout = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.tls_ciphers = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack sudo[75958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.tls_min_version = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.verify_ssl = True {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican.verify_ssl_path = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.auth_section = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.auth_type = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.cafile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.certfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack sudo[75958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.collect_timing = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.insecure = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.keyfile = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.split_loggers = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.timeout = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.tls_ciphers = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] barbican_service_user.tls_min_version = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.approle_role_id = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.approle_secret_id = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.auth_method = approle {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.auth_path = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.kv_mountpoint = secret {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.kv_path = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.kv_version = 2 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.namespace = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.root_token_id = **** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.ssl_ca_crt_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.timeout = 60.0 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.token_file = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.token_role = None {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.use_ssl = False {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:02 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] ******************************************************************************** {{(pid=75753) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:01:03 devstack sudo[75958]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.381s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:03 devstack sudo[76140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:03 devstack sudo[76140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:03 devstack sudo[76140]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.398s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:01:03 devstack cinder-volume[75916]: INFO cinder.brick.local_dev.lvm [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:03 devstack sudo[76237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:01:03 devstack sudo[76237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:03 devstack sudo[76237]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG cinder.brick.local_dev.lvm [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75916) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 18:01:03 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:03 devstack sudo[76319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:03 devstack sudo[76319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:04 devstack sudo[76319]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:04 devstack sudo[76488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:04 devstack sudo[76488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:04 devstack sudo[76488]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.333s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:04 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:04 devstack sudo[76568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 18:01:04 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:05 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:05 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.280s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:05 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:05 devstack sudo[76592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:01:05 devstack sudo[76592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:05 devstack sudo[76592]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:05 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:05 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:05 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:01:05 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:05 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:05 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:05 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:05 devstack sudo[76664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:05 devstack sudo[76664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:06 devstack sudo[76664]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:06 devstack sudo[76748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:06 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:06 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:06 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:06 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:06 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[75916]: INFO cinder.volume.drivers.lvm [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:06 devstack sudo[76756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:06 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:06 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG cinder.volume.drivers.lvm [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Updating volume stats {{(pid=75916) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:01:06 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:06 devstack sudo[76759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:01:06 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:07 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:07 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:07 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:07 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:07 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:07 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:07 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:07 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:07 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:07 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:07 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:07 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:07 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:07 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:07 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[75916]: INFO cinder.volume.driver [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG cinder.volume.driver [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75916) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG oslo_db.sqlalchemy.engines [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG dbcounter [-] [75916] Writer thread running {{(pid=75916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG cinder.db.api [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Building query based on filter {{(pid=75916) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG cinder.image.image_utils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75916) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:01:08 devstack cinder-volume[75916]: INFO cinder.keymgr.migration [None req-956ee47d-baa6-4bac-ae7b-27d35969fff1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG cinder.volume.drivers.lvm [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Updating volume stats {{(pid=75916) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:08 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:01:08 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:08 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:08 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:08 devstack sudo[76786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:08 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:09 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:09 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:09 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:09 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG cinder.manager [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Notifying Schedulers of capabilities ... {{(pid=75916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:09 devstack cinder-volume[75916]: INFO cinder.volume.manager [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Driver initialization completed successfully. Sep 28 18:01:09 devstack cinder-volume[75916]: INFO cinder.manager [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Initiating service 2 cleanup Sep 28 18:01:09 devstack cinder-volume[75916]: INFO cinder.manager [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Service 2 cleanup completed. Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG cinder.service [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Creating RPC server for service cinder-volume {{(pid=75916) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG cinder.service [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75916) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:01:09 devstack cinder-volume[75916]: INFO cinder.volume.manager [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG cinder.volume.drivers.lvm [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Updating volume stats {{(pid=75916) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:09 devstack sudo[76794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:01:09 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:09 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:09 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:09 devstack sudo[76797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:09 devstack sudo[76797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:10 devstack sudo[76797]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:10 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:10 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:10 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:10 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:10 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:10 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:10 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:10 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:10 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:10 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:10 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:10 devstack cinder-volume[75916]: INFO cinder.volume.manager [None req-a6ac7f45-362a-4453-8b2d-aeb5eb025fc5 None None] Driver post RPC initialization completed successfully. Sep 28 18:01:12 devstack cinder-volume[75753]: DEBUG dbcounter [-] [75753] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:19 devstack cinder-volume[75916]: DEBUG dbcounter [-] [75916] Writing DB stats cinder:SELECT=3 {{(pid=75916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:20 devstack cinder-volume[75916]: DEBUG dbcounter [-] [75916] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:48 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager._thread_info {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:01:48 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread count: 6 {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:01:48 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread info: [<_MainThread(MainThread, started 140043302842496)>, , , , , ] {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:02:48 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:02:48 devstack cinder-volume[75916]: DEBUG cinder.volume.drivers.lvm [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Updating volume stats {{(pid=75916) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:02:48 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:48 devstack sudo[81882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:02:48 devstack sudo[81882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:49 devstack sudo[81882]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:49 devstack sudo[81885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:02:49 devstack sudo[81885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:49 devstack sudo[81885]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:49 devstack sudo[81888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:02:49 devstack sudo[81888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:49 devstack sudo[81888]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.336s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:49 devstack sudo[81891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:02:49 devstack sudo[81891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:49 devstack sudo[81891]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG cinder.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Notifying Schedulers of capabilities ... {{(pid=75916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager._thread_info {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread count: 6 {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:02:49 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread info: [<_MainThread(MainThread, started 140043302842496)>, , , , , ] {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:03:20 devstack cinder-volume[75916]: DEBUG dbcounter [-] [75916] Writing DB stats cinder:SELECT=1 {{(pid=75916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:03:20 devstack cinder-volume[75916]: DEBUG dbcounter [-] [75916] Writing DB stats cinder:UPDATE=1 {{(pid=75916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:03:48 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:03:48 devstack cinder-volume[75916]: DEBUG cinder.volume.drivers.lvm [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Updating volume stats {{(pid=75916) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:03:48 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:48 devstack sudo[83300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:03:48 devstack sudo[83300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:49 devstack sudo[83300]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.367s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:49 devstack sudo[83303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:03:49 devstack sudo[83303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:49 devstack sudo[83303]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:49 devstack sudo[83315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:03:49 devstack sudo[83315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:49 devstack sudo[83315]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:49 devstack sudo[83322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:03:49 devstack sudo[83322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:50 devstack sudo[83322]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:50 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:50 devstack cinder-volume[75916]: DEBUG cinder.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Notifying Schedulers of capabilities ... {{(pid=75916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:50 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager._thread_info {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:03:50 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread count: 6 {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:03:50 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread info: [<_MainThread(MainThread, started 140043302842496)>, , , , , ] {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:04:48 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:48 devstack cinder-volume[75916]: DEBUG cinder.volume.drivers.lvm [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Updating volume stats {{(pid=75916) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:04:48 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:48 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:04:48 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:49 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:49 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:04:49 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:49 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:49 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:04:49 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:49 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:49 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:04:49 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:49 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG cinder.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Notifying Schedulers of capabilities ... {{(pid=75916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager._thread_info {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread count: 6 {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:04:49 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread info: [<_MainThread(MainThread, started 140043302842496)>, , , , , ] {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:05:20 devstack cinder-volume[75916]: DEBUG dbcounter [-] [75916] Writing DB stats cinder:SELECT=1 {{(pid=75916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:20 devstack cinder-volume[75916]: DEBUG dbcounter [-] [75916] Writing DB stats cinder:UPDATE=1 {{(pid=75916) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:48 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:48 devstack cinder-volume[75916]: DEBUG cinder.volume.drivers.lvm [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Updating volume stats {{(pid=75916) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:05:48 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:48 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:05:48 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:48 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:48 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:48 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:49 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:05:49 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:49 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:49 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:05:49 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:49 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:49 devstack sudo[85883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:05:49 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:49 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG oslo_concurrency.processutils [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=75916) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG cinder.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Notifying Schedulers of capabilities ... {{(pid=75916) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG oslo_service.periodic_task [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] Running periodic task VolumeManager._thread_info {{(pid=75916) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread count: 6 {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:05:49 devstack cinder-volume[75916]: DEBUG cinder.volume.manager [None req-6472679b-83ed-4355-ad04-7e365fa914f8 None None] thread info: [<_MainThread(MainThread, started 140043302842496)>, , , , , ] {{(pid=75916) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:05:50 devstack cinder-volume[75753]: INFO oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Caught SIGTERM, stopping children Sep 28 18:05:50 devstack cinder-volume[75753]: DEBUG oslo_concurrency.lockutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Acquiring lock "singleton_lock" {{(pid=75753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:05:50 devstack cinder-volume[75753]: DEBUG oslo_concurrency.lockutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Acquired lock "singleton_lock" {{(pid=75753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:05:50 devstack cinder-volume[75753]: DEBUG oslo_concurrency.lockutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Releasing lock "singleton_lock" {{(pid=75753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:05:50 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Stop services. {{(pid=75753) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:05:50 devstack cinder-volume[75753]: DEBUG oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Killing children. {{(pid=75753) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:05:50 devstack cinder-volume[75753]: INFO oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Waiting on 1 children to exit Sep 28 18:05:54 devstack cinder-volume[75916]: DEBUG oslo_concurrency.lockutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Acquiring lock "singleton_lock" {{(pid=75916) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:05:54 devstack cinder-volume[75916]: DEBUG oslo_concurrency.lockutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Acquired lock "singleton_lock" {{(pid=75916) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:05:54 devstack cinder-volume[75916]: DEBUG oslo_concurrency.lockutils [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Releasing lock "singleton_lock" {{(pid=75916) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:05:54 devstack cinder-volume[75916]: WARNING amqp [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:05:54 devstack cinder-volume[75916]: WARNING amqp [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:05:54 devstack cinder-volume[75753]: INFO oslo_service.backend._eventlet.service [None req-90848afe-4166-4820-9fa3-d268caf3a235 None None] Child 75916 exited with status 0 Sep 28 18:05:54 devstack cinder-volume[86059]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:05:54 devstack cinder-volume[86059]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:05:54 devstack cinder-volume[86059]: we strongly recommend against using it for new projects. Sep 28 18:05:54 devstack cinder-volume[86059]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:05:54 devstack cinder-volume[86059]: framework. For more detail see Sep 28 18:05:54 devstack cinder-volume[86059]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:05:54 devstack cinder-volume[86059]: import eventlet # noqa Sep 28 18:05:57 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:05:57 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:05:57 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:05:58 devstack cinder-volume[86059]: INFO dbcounter [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Registered counter for database cinder Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG dbcounter [-] [86059] Writer thread running {{(pid=86059) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:05:58 devstack cinder-volume[86059]: INFO cinder.rpc [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:05:58 devstack cinder-volume[86059]: INFO cinder.rpc [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:05:58 devstack cinder-volume[86059]: INFO cinder.volume.manager [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Determined volume DB was empty at startup. Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG cinder.volume.manager [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86059) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:05:58 devstack cinder-volume[86059]: INFO cinder.volume.manager [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 18:05:58 devstack cinder-volume[86059]: WARNING stevedore.named [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:05:58 devstack cinder-volume[86059]: WARNING castellan.key_manager [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:05:58 devstack cinder-volume[86059]: WARNING cinder.keymgr.conf_key_mgr [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:05:58 devstack cinder-volume[86059]: INFO cinder.volume.manager [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:05:58 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Starting 1 workers Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Started child 86340 {{(pid=86059) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Full set of CONF: {{(pid=86059) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] ******************************************************************************** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Configuration options gathered from: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] ================================================================================ {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] allow_availability_zone_fallback = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] allow_compression_on_image_upload = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] allowed_direct_url_schemes = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] api_rate_limit = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] auth_strategy = keystone {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_host = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_stats_polling_interval = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backup_api_class = cinder.backup.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backup_name_template = backup-%s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backup_use_same_host = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backup_use_temp_snapshot = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] chap_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] chap_username = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_internal_tenant_project_id = 8b207ed08d84412599c34dde72c037eb {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_internal_tenant_user_id = 0320533558ff4906b33ccd384845cc5d {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cluster = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] compression_format = gzip {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] compute_api_class = cinder.compute.nova.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] config_dir = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] config_source = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86340]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] control_exchange = openstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] debug = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] default_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] default_group_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] default_volume_type = QuobyteHD {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] disk_geometry = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] driver_client_cert = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] driver_client_cert_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] driver_data_namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] driver_ssl_cert_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] driver_ssl_cert_verify = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] driver_use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] enable_new_services = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] enable_unsupported_driver = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] enabled_backends = ['QuobyteHD'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] enforce_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] filter_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_api_insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_api_ssl_compression = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_ca_certificates_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_catalog_info = image:glance:publicURL {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_num_retries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance_request_timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] goodness_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] graceful_shutdown_timeout = 5 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] group_api_class = cinder.group.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] host = devstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_compress_on_upload = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_conversion_address_space_limit = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_conversion_cpu_limit = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_conversion_disable = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_introspection_address_space_limit = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_introspection_cpu_limit = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_upload_use_cinder_backend = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_upload_use_internal_tenant = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_volume_cache_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_volume_cache_max_count = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] image_volume_cache_max_size_gb = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] init_host_max_objects_retrieval = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] instance_format = [instance: %(uuid)s] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] iscsi_target_flags = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] iscsi_write_cache = on {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] iser_helper = tgtadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] iser_ip_address = 192.168.122.7 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] iser_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_color = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_config_append = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_dir = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_options = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_rotate_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_rotate_interval_type = days {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] log_rotation_type = none {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] max_age = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] max_logfile_count = 30 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] max_logfile_size_mb = 200 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] max_over_subscription_ratio = 20.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] message_reap_interval = 86400 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] message_ttl = 2592000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] migration_create_volume_timeout_secs = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] monkey_patch = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] monkey_patch_modules = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] my_ip = 192.168.122.7 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] no_snapshot_gb_quota = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] num_iser_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] num_shell_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] num_volume_device_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] nvmeof_conn_info_version = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] nvmet_ns_id = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] nvmet_port_id = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] osapi_max_limit = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] osapi_volume_ext_list = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] osapi_volume_listen_port = 8776 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] osapi_volume_use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] osapi_volume_workers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] per_volume_size_limit = -1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] periodic_fuzzy_delay = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] periodic_interval = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] public_endpoint = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] publish_errors = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] quota_backup_gigabytes = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] quota_backups = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] quota_gigabytes = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] quota_groups = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] quota_snapshots = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] quota_volumes = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] rate_limit_burst = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] rate_limit_except_level = CRITICAL {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] rate_limit_interval = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] reinit_driver_count = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] replication_device = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] report_discard_supported = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] report_interval = 120 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] reservation_clean_interval = 86400 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] reservation_expire = 86400 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] reserved_image_namespaces = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] reserved_percentage = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] rpc_response_timeout = 120 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] run_external_periodic_tasks = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] scst_target_driver = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] scst_target_iqn_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_down_time = 720 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] shell_completion = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] snapshot_name_template = snapshot-%s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] state_path = /opt/stack/data/cinder {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] storage_availability_zone = nova {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] storage_protocol = iSCSI {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] syslog_log_facility = LOG_USER {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] target_helper = lioadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] target_ip_address = 192.168.122.7 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] target_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] target_protocol = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] target_secondary_ip_addresses = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] trace_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] transport_url = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] until_refresh = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] use_chap_auth = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] use_default_quota_class = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] use_journal = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] use_json = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] use_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] use_stderr = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] use_syslog = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] verify_glance_signatures = enabled {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_api_class = cinder.volume.api.API {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_backend_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_clear = zero {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_clear_ionice = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_clear_size = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_copy_bps_limit = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_dd_blocksize = 1M {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_name_template = volume-%s {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_service_inithost_offload = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volume_usage_audit_period = month {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] zoning_mode = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_concurrency.disable_process_locking = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.auth_type = password {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.auth_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.cache = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.include_service_catalog = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:58 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.interface = public {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcache_username = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.region_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.service_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.backend = dogpile.cache.null {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.backend_argument = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.backend_expiration_time = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.config_prefix = cache.oslo {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.debug_cache_backend = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.enable_retry_client = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.enable_socket_keepalive = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.expiration_time = 600 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.hashclient_retry_attempts = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.memcache_dead_retry = 300 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.memcache_pool_maxsize = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.memcache_sasl_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.proxies = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.redis_db = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.redis_server = localhost:6379 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.retry_attempts = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.retry_delay = 0.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.socket_keepalive_count = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.socket_keepalive_idle = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.socket_keepalive_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.socket_timeout = 1.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.tls_allowed_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.tls_cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.tls_certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.tls_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.tls_keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cache.username = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] coordination.backend_url = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.asyncio_connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.asyncio_slave_connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.backend = sqlalchemy {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.connection_debug = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.connection_parameters = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.connection_recycle_time = 3600 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.connection_trace = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.db_inc_retry_interval = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.db_max_retries = 20 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.db_max_retry_interval = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.db_retry_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.max_overflow = 50 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.max_pool_size = 5 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.remotefs [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86340) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.max_retries = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.mysql_wsrep_sync_wait = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.pool_timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.retry_interval = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.slave_connection = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.sqlite_synchronous = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.synchronous_reader = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] database.use_db_reconnect = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_tracing.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.connection_string = messaging:// {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.es_doc_type = notification {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.es_scroll_size = 10000 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.es_scroll_time = 2m {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.filter_error_trace = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.hmac_keys = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.sentinel_service_name = mymaster {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.socket_timeout = 0.1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.trace_requests = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler.trace_sqlalchemy = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler_jaeger.process_tags = {} {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler_jaeger.service_name_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] profiler_otlp.service_name_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.enforce_new_defaults = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.policy_default_rule = default {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.policy_file = policy.yaml {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] privsep_osbrick.group = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] privsep_osbrick.helper_command = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] privsep_osbrick.user = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_sys_admin.group = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_sys_admin.helper_command = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] cinder_sys_admin.user = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.auth_type = password {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.send_service_user_token = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] service_user.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.auth_type = password {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.region_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] glance.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.backend_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.chap_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.chap_username = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.disk_geometry = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.driver_client_cert = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.driver_client_cert_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.driver_data_namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.driver_use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.extra_capabilities = {} {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.filter_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.goodness_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.iscsi_target_flags = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.iscsi_write_cache = on {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.iser_helper = tgtadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.iser_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_host = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_login = admin {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_mount_options = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_private_key = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_share_path = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.num_shell_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.quobyte_volume_url = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.replication_device = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.report_discard_supported = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.reserved_percentage = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.target_helper = tgtadm {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.target_port = 3260 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.target_protocol = iscsi {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.trace_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.unique_fqdn_network = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.use_chap_auth = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_backend_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_clear = zero {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_clear_ionice = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_clear_size = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_reports.file_event_handler = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_reports.log_dir = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.backend_availability_zone = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.backend_host = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.chap_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.chap_username = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.chiscsi_conf = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.disk_geometry = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.driver_client_cert = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.driver_data_namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.driver_use_ssl = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.extra_capabilities = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.filter_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.goodness_function = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.iser_helper = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.iser_ip_address = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.iser_port = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.iser_target_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_host = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_login = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_mount_options = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_password = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_private_key = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_share_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_ssh_port = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.num_shell_tries = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.nvmet_port_id = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.replication_device = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.report_discard_supported = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.reserved_percentage = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.scst_target_driver = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.storage_protocol = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.target_helper = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.target_ip_address = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.target_port = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.target_prefix = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.target_protocol = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.trace_flags = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.use_chap_auth = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_clear = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_clear_size = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] QuobyteHD.volumes_dir = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86340) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_notifications.driver = [] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_notifications.retry = -1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] key_manager.fixed_key = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86340]: WARNING cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:05:59 devstack cinder-volume[86340]: WARNING cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.barbican_api_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.barbican_endpoint = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.barbican_endpoint_type = public {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.barbican_region_name = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.number_of_retries = 60 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.retry_delay = 1 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.send_service_user_token = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Running cmd (subprocess): mount.quobyte {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.verify_ssl = True {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican.verify_ssl_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.auth_section = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.auth_type = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.cafile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.certfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.collect_timing = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.insecure = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.keyfile = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.split_loggers = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.timeout = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.tls_ciphers = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] barbican_service_user.tls_min_version = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.approle_role_id = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.approle_secret_id = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.auth_method = approle {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.auth_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.kv_mountpoint = secret {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.kv_path = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.kv_version = 2 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.namespace = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.root_token_id = **** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.ssl_ca_crt_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.timeout = 60.0 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.token_file = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.token_role = None {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.use_ssl = False {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:05:59 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] ******************************************************************************** {{(pid=86059) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:05:59 devstack quobyte-client[86352]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 18:05:59 devstack quobyte-client[86352]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86340) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:59 devstack cinder-volume[86340]: INFO cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef ... Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 -c /etc/quobyte/client-cinder.cfg {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:59 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 -c /etc/quobyte/client-cinder.cfg Sep 28 18:05:59 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:59 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.477s {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:59 devstack cinder-volume[86340]: INFO cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef succeeded Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86340) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.491s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:59 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:59 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:05:59 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.285s {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:00 devstack cinder-volume[86340]: INFO cinder.volume.driver [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.volume.driver [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1126708984375, 'free_capacity_gb': 1775.1126708984375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86340) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_db.sqlalchemy.engines [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG dbcounter [-] [86340] Writer thread running {{(pid=86340) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.db.api [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Building query based on filter {{(pid=86340) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.image.image_utils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86340) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:06:00 devstack cinder-volume[86340]: INFO cinder.keymgr.migration [None req-e0735d99-0cd9-49a6-a07a-4e64379a4cb6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86340) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86340) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:00 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:06:00 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.343s {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.manager [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Notifying Schedulers of capabilities ... {{(pid=86340) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:00 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Driver initialization completed successfully. Sep 28 18:06:00 devstack cinder-volume[86340]: INFO cinder.manager [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Initiating service 3 cleanup Sep 28 18:06:00 devstack cinder-volume[86340]: INFO cinder.manager [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Service 3 cleanup completed. Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.service [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Creating RPC server for service cinder-volume {{(pid=86340) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.service [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86340) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:06:00 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86340) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86340) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:00 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:06:00 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:00 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.238s {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:00 devstack cinder-volume[86340]: INFO cinder.volume.manager [None req-d08b4c65-f52f-4f4b-aaee-20b4876b80ba None None] Driver post RPC initialization completed successfully. Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86340) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG cinder.volume.drivers.quobyte [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86340) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86340) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:05 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:06:05 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:05 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG oslo_concurrency.processutils [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.281s {{(pid=86340) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:05 devstack cinder-volume[86340]: DEBUG cinder.manager [None req-19bc1ea0-93f0-4c41-be00-229e9dd86da2 None None] Notifying Schedulers of capabilities ... {{(pid=86340) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:08 devstack cinder-volume[86059]: DEBUG dbcounter [-] [86059] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86059) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:09 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Caught SIGTERM, stopping children Sep 28 18:06:09 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Acquiring lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:06:09 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Acquired lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:06:09 devstack cinder-volume[86059]: DEBUG oslo_concurrency.lockutils [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Releasing lock "singleton_lock" {{(pid=86059) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:06:09 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Stop services. {{(pid=86059) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:06:09 devstack cinder-volume[86059]: DEBUG oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Killing children. {{(pid=86059) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:06:09 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Waiting on 1 children to exit Sep 28 18:06:10 devstack cinder-volume[86340]: DEBUG dbcounter [-] [86340] Writing DB stats cinder:SELECT=4 {{(pid=86340) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:11 devstack cinder-volume[86340]: DEBUG dbcounter [-] [86340] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86340) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:11 devstack cinder-volume[86340]: DEBUG oslo_service.periodic_task [None req-06d346b0-db8b-4dc0-a0ff-69af2cbb18e7 None None] Running periodic task VolumeManager._thread_info {{(pid=86340) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:11 devstack cinder-volume[86340]: DEBUG cinder.volume.manager [None req-06d346b0-db8b-4dc0-a0ff-69af2cbb18e7 None None] thread count: 6 {{(pid=86340) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:06:11 devstack cinder-volume[86340]: DEBUG cinder.volume.manager [None req-06d346b0-db8b-4dc0-a0ff-69af2cbb18e7 None None] thread info: [<_MainThread(MainThread, started 129565046657152)>, , , , , ] {{(pid=86340) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:06:13 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Acquiring lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:06:13 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Acquired lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:06:13 devstack cinder-volume[86340]: DEBUG oslo_concurrency.lockutils [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Releasing lock "singleton_lock" {{(pid=86340) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:06:13 devstack cinder-volume[86340]: WARNING amqp [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:06:13 devstack cinder-volume[86340]: WARNING amqp [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:06:14 devstack cinder-volume[86059]: INFO oslo_service.backend._eventlet.service [None req-f2c00eb0-51e6-4d60-b4a1-7d21b336a457 None None] Child 86340 exited with status 0 Sep 28 18:06:14 devstack cinder-volume[86716]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:06:14 devstack cinder-volume[86716]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:06:14 devstack cinder-volume[86716]: we strongly recommend against using it for new projects. Sep 28 18:06:14 devstack cinder-volume[86716]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:06:14 devstack cinder-volume[86716]: framework. For more detail see Sep 28 18:06:14 devstack cinder-volume[86716]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:06:14 devstack cinder-volume[86716]: import eventlet # noqa Sep 28 18:06:18 devstack cinder-volume[86716]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:06:18 devstack cinder-volume[86716]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:06:18 devstack cinder-volume[86716]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:06:18 devstack cinder-volume[86716]: INFO dbcounter [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Registered counter for database cinder Sep 28 18:06:18 devstack cinder-volume[86716]: DEBUG oslo_db.sqlalchemy.engines [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG dbcounter [-] [86716] Writer thread running {{(pid=86716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:06:19 devstack cinder-volume[86716]: INFO cinder.rpc [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:06:19 devstack cinder-volume[86716]: INFO cinder.rpc [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_db.sqlalchemy.engines [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:19 devstack cinder-volume[86716]: INFO cinder.volume.manager [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Determined volume DB was empty at startup. Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG cinder.volume.manager [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86716) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:06:19 devstack cinder-volume[86716]: WARNING stevedore.named [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:06:19 devstack cinder-volume[86716]: WARNING castellan.key_manager [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:06:19 devstack cinder-volume[86716]: WARNING cinder.keymgr.conf_key_mgr [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:06:19 devstack cinder-volume[86716]: INFO cinder.volume.manager [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_db.sqlalchemy.engines [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:19 devstack cinder-volume[86716]: INFO oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Starting 1 workers Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Started child 86981 {{(pid=86716) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Full set of CONF: {{(pid=86716) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] ******************************************************************************** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] Configuration options gathered from: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] ================================================================================ {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] allow_availability_zone_fallback = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] allow_compression_on_image_upload = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] allowed_direct_url_schemes = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86981]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] api_rate_limit = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] auth_strategy = keystone {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_host = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_stats_polling_interval = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backup_api_class = cinder.backup.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backup_name_template = backup-%s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backup_use_same_host = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backup_use_temp_snapshot = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] chap_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] chap_username = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_internal_tenant_project_id = 8b207ed08d84412599c34dde72c037eb {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_internal_tenant_user_id = 0320533558ff4906b33ccd384845cc5d {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cluster = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] compression_format = gzip {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] config_dir = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] config_source = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] control_exchange = openstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] debug = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] default_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] default_group_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] default_volume_type = QuobyteHD {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] disk_geometry = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] driver_client_cert = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] driver_client_cert_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] driver_data_namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] driver_ssl_cert_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] driver_ssl_cert_verify = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] driver_use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] enable_new_services = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] enable_unsupported_driver = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] enforce_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] filter_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_api_insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_api_ssl_compression = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_ca_certificates_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_num_retries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance_request_timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] goodness_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] graceful_shutdown_timeout = 5 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] group_api_class = cinder.group.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] host = devstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_compress_on_upload = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_conversion_address_space_limit = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_conversion_cpu_limit = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_conversion_disable = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_introspection_address_space_limit = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_introspection_cpu_limit = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_upload_use_cinder_backend = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_upload_use_internal_tenant = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_volume_cache_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_volume_cache_max_count = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] init_host_max_objects_retrieval = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] instance_format = [instance: %(uuid)s] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] iscsi_target_flags = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] iscsi_write_cache = on {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] iser_helper = tgtadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] iser_ip_address = 192.168.122.7 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] iser_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_color = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_config_append = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_dir = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_options = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_rotate_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_rotate_interval_type = days {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] log_rotation_type = none {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] max_age = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] max_logfile_count = 30 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] max_logfile_size_mb = 200 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] max_over_subscription_ratio = 20.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] message_reap_interval = 86400 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] message_ttl = 2592000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] monkey_patch = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] monkey_patch_modules = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] my_ip = 192.168.122.7 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] no_snapshot_gb_quota = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] num_iser_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] num_shell_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] num_volume_device_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] nvmeof_conn_info_version = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] nvmet_ns_id = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] nvmet_port_id = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] osapi_max_limit = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] osapi_volume_ext_list = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86981) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] osapi_volume_listen_port = 8776 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] osapi_volume_use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] osapi_volume_workers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] per_volume_size_limit = -1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] periodic_fuzzy_delay = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] periodic_interval = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] public_endpoint = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] publish_errors = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] quota_backup_gigabytes = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] quota_backups = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] quota_gigabytes = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] quota_groups = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] quota_snapshots = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] quota_volumes = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] rate_limit_burst = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] rate_limit_except_level = CRITICAL {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] rate_limit_interval = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] reinit_driver_count = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] replication_device = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] report_discard_supported = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] report_interval = 120 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] reservation_clean_interval = 86400 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] reservation_expire = 86400 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] reserved_image_namespaces = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] reserved_percentage = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] rpc_response_timeout = 120 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] run_external_periodic_tasks = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] scst_target_driver = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] scst_target_iqn_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_down_time = 720 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] shell_completion = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] snapshot_name_template = snapshot-%s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] state_path = /opt/stack/data/cinder {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] storage_availability_zone = nova {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] storage_protocol = iSCSI {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] syslog_log_facility = LOG_USER {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] target_helper = lioadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] target_ip_address = 192.168.122.7 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] target_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] target_protocol = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] target_secondary_ip_addresses = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] trace_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] transport_url = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] until_refresh = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] use_chap_auth = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] use_default_quota_class = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] use_journal = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] use_json = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] use_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] use_stderr = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] use_syslog = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] verify_glance_signatures = enabled {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_api_class = cinder.volume.api.API {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_backend_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_clear = zero {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_clear_ionice = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_clear_size = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_copy_bps_limit = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_dd_blocksize = 1M {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_name_template = volume-%s {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_service_inithost_offload = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volume_usage_audit_period = month {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] zoning_mode = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.auth_type = password {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.auth_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.cache = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.interface = public {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcache_username = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.region_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.service_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.backend = dogpile.cache.null {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.backend_argument = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.backend_expiration_time = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.config_prefix = cache.oslo {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.debug_cache_backend = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.enable_retry_client = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.enable_socket_keepalive = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.expiration_time = 600 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.memcache_dead_retry = 300 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.memcache_sasl_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.proxies = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.redis_db = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.redis_server = localhost:6379 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.retry_attempts = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.retry_delay = 0.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.socket_keepalive_count = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.socket_keepalive_idle = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.socket_keepalive_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.socket_timeout = 1.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.tls_allowed_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.tls_cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.tls_certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.tls_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.tls_keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cache.username = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] coordination.backend_url = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.asyncio_connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.asyncio_slave_connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.backend = sqlalchemy {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.connection_debug = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.connection_parameters = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.connection_recycle_time = 3600 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.connection_trace = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.db_inc_retry_interval = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.db_max_retries = 20 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.db_max_retry_interval = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.db_retry_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.max_overflow = 50 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.max_pool_size = 5 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.max_retries = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.pool_timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.retry_interval = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.slave_connection = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.sqlite_synchronous = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.synchronous_reader = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] database.use_db_reconnect = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86981) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_tracing.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.connection_string = messaging:// {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.es_doc_type = notification {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.es_scroll_size = 10000 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.es_scroll_time = 2m {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.filter_error_trace = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.hmac_keys = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.sentinel_service_name = mymaster {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.socket_timeout = 0.1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.trace_requests = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler.trace_sqlalchemy = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler_jaeger.process_tags = {} {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] profiler_otlp.service_name_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.policy_default_rule = default {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Running cmd (subprocess): mount.quobyte {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] privsep_osbrick.group = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] privsep_osbrick.helper_command = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] privsep_osbrick.user = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_sys_admin.group = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_sys_admin.helper_command = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] cinder_sys_admin.user = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.auth_type = password {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.send_service_user_token = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] service_user.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.auth_type = password {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.region_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] glance.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.backend_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.chap_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.chap_username = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.disk_geometry = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.driver_client_cert = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.driver_data_namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.driver_use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.extra_capabilities = {} {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.filter_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.goodness_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.iscsi_target_flags = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.iser_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_host = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_login = admin {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_mount_options = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_private_key = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_share_path = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.replication_device = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.report_discard_supported = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.target_helper = tgtadm {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.target_port = 3260 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.target_protocol = iscsi {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.trace_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.use_chap_auth = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_backend_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_clear = zero {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_reports.file_event_handler = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_reports.log_dir = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.backend_host = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.chap_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.chap_username = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.disk_geometry = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.driver_client_cert = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.extra_capabilities = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.filter_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.goodness_function = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack quobyte-client[86982]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.iser_helper = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack quobyte-client[86982]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.iser_ip_address = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.iser_port = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_host = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_login = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_mount_options = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_password = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_private_key = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_share_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.num_shell_tries = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] CMD "mount.quobyte" returned: 1 in 0.103s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.replication_device = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.report_discard_supported = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.reserved_percentage = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.scst_target_driver = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.storage_protocol = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.target_helper = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.target_ip_address = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.target_port = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.target_prefix = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.target_protocol = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.trace_flags = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.use_chap_auth = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_clear = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_clear_size = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] QuobyteHD.volumes_dir = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_notifications.driver = [] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] key_manager.fixed_key = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.barbican_api_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.barbican_endpoint = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.barbican_endpoint_type = public {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.barbican_region_name = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.number_of_retries = 60 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.retry_delay = 1 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.send_service_user_token = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.verify_ssl = True {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican.verify_ssl_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.auth_section = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.auth_type = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.cafile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.certfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.collect_timing = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.insecure = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.keyfile = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.split_loggers = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.timeout = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.tls_ciphers = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] barbican_service_user.tls_min_version = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.approle_role_id = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.approle_secret_id = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.auth_method = approle {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.auth_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.kv_mountpoint = secret {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.kv_path = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.kv_version = 2 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.namespace = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.root_token_id = **** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.ssl_ca_crt_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.timeout = 60.0 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.token_file = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.token_role = None {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.use_ssl = False {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:06:19 devstack cinder-volume[86716]: DEBUG oslo_service.backend._eventlet.service [None req-5abfd671-7fb7-44bc-92ca-28cbccce58b8 None None] ******************************************************************************** {{(pid=86716) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:06:19 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.254s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:19 devstack cinder-volume[86981]: INFO cinder.volume.driver [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:06:19 devstack cinder-volume[86981]: DEBUG cinder.volume.driver [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1100692749023, 'free_capacity_gb': 1775.1100692749023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86981) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_db.sqlalchemy.engines [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writer thread running {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.db.api [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Building query based on filter {{(pid=86981) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86981) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:20 devstack cinder-volume[86981]: INFO cinder.keymgr.migration [None req-e67ae50b-04b5-44a8-94b3-feabc4282d48 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:06:20 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:06:20 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:20 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.255s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:20 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Driver initialization completed successfully. Sep 28 18:06:20 devstack cinder-volume[86981]: INFO cinder.manager [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Initiating service 3 cleanup Sep 28 18:06:20 devstack cinder-volume[86981]: INFO cinder.manager [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Service 3 cleanup completed. Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.service [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Creating RPC server for service cinder-volume {{(pid=86981) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.service [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86981) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:06:20 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:20 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:06:20 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:20 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.254s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:20 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d05e3e61-f2ba-41ce-a714-80edaf41ce2e None None] Driver post RPC initialization completed successfully. Sep 28 18:06:29 devstack cinder-volume[86716]: DEBUG dbcounter [-] [86716] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 6 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:06:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Flow 'volume_create_manager' (1c3ac3bd-2b00-4cad-8ecf-67d1d71df4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556090f1-6082-4b8d-b83f-ca7d44abb012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556090f1-6082-4b8d-b83f-ca7d44abb012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1356143921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ea9053-d522-42db-809b-6aad4592e472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cde756249f943f88ee0f615a16e1738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:25Z,use_quota=True,user_id='bee2f01a12184cd1bd3553c93bbedc14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da4620a-c196-4752-ab14-9e6da7549ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da4620a-c196-4752-ab14-9e6da7549ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41648390-090d-4bcd-9d8c-056c4f712f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41648390-090d-4bcd-9d8c-056c4f712f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5ea9053-d522-42db-809b-6aad4592e472', 'volume_name': 'volume-f5ea9053-d522-42db-809b-6aad4592e472', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63126d2d-5d73-4a1c-9186-81fbe8515649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63126d2d-5d73-4a1c-9186-81fbe8515649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300d60cd-3ea1-474d-ad11-b1646b56efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:25 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Volume f5ea9053-d522-42db-809b-6aad4592e472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5ea9053-d522-42db-809b-6aad4592e472', 'volume_size': 1} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1356143921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5ea9053-d522-42db-809b-6aad4592e472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cde756249f943f88ee0f615a16e1738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:25Z,use_quota=True,user_id='bee2f01a12184cd1bd3553c93bbedc14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Creating volume f5ea9053-d522-42db-809b-6aad4592e472 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:25 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:07:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:25 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 1073741824 Sep 28 18:07:25 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:26 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 1073741824" returned: 0 in 0.767s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:26 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 Sep 28 18:07:26 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:26 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300d60cd-3ea1-474d-ad11-b1646b56efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5ea9053-d522-42db-809b-6aad4592e472', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bde997e-beec-4d50-bd06-13a96d53ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Volume volume-f5ea9053-d522-42db-809b-6aad4592e472 (f5ea9053-d522-42db-809b-6aad4592e472): created successfully Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bde997e-beec-4d50-bd06-13a96d53ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Flow 'volume_create_manager' (1c3ac3bd-2b00-4cad-8ecf-67d1d71df4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5d451310-9962-47be-97ce-e657c45b15ff tempest-TaggedAttachmentsTest-210731958 None] Created volume successfully. Sep 28 18:07:36 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:36 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:38 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:07:38 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:39 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.448s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 6 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:07:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Flow 'volume_create_manager' (99d31c19-3946-4ec2-823d-ce10d44f76a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f03ddf5-13f4-40f1-9480-939633043231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f03ddf5-13f4-40f1-9480-939633043231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-64049926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be1b06-a926-4f57-9e8c-83f984d87286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e1588ad6274b099ccf5f1b95df4f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:04Z,use_quota=True,user_id='4a12bf04447a4c4b9b66570633aed795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef530797-170d-4610-b7b4-f0952c56f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef530797-170d-4610-b7b4-f0952c56f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d7eac0-b447-45c9-af62-1050682b2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d7eac0-b447-45c9-af62-1050682b2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1be1b06-a926-4f57-9e8c-83f984d87286', 'volume_name': 'volume-d1be1b06-a926-4f57-9e8c-83f984d87286', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30ee212-caf2-47e2-8081-80e9a2bc65d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30ee212-caf2-47e2-8081-80e9a2bc65d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb20fb4-5ba3-470f-b818-d9fb7ffbd478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Volume d1be1b06-a926-4f57-9e8c-83f984d87286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1be1b06-a926-4f57-9e8c-83f984d87286', 'volume_size': 1} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-64049926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be1b06-a926-4f57-9e8c-83f984d87286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e1588ad6274b099ccf5f1b95df4f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:04Z,use_quota=True,user_id='4a12bf04447a4c4b9b66570633aed795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Creating volume d1be1b06-a926-4f57-9e8c-83f984d87286 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:04 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:08:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 1073741824 Sep 28 18:08:04 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:05 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 1073741824" returned: 0 in 1.218s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:05 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 Sep 28 18:08:05 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:06 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286" returned: 0 in 0.666s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb20fb4-5ba3-470f-b818-d9fb7ffbd478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1be1b06-a926-4f57-9e8c-83f984d87286', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c026efb-d5ba-4b09-8567-5d6aa4039400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:06 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Volume volume-d1be1b06-a926-4f57-9e8c-83f984d87286 (d1be1b06-a926-4f57-9e8c-83f984d87286): created successfully Sep 28 18:08:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c026efb-d5ba-4b09-8567-5d6aa4039400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Flow 'volume_create_manager' (99d31c19-3946-4ec2-823d-ce10d44f76a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:06 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-48cce1cd-7620-49eb-a19b-ad15853c219f tempest-VolumesAdminNegativeTest-983457840 None] Created volume successfully. Sep 28 18:08:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Acquiring lock "cinder-d1be1b06-a926-4f57-9e8c-83f984d87286-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Lock "cinder-d1be1b06-a926-4f57-9e8c-83f984d87286-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Acquiring lock "cinder-quobyte-d1be1b06-a926-4f57-9e8c-83f984d87286" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Lock "cinder-quobyte-d1be1b06-a926-4f57-9e8c-83f984d87286" acquired by "delete_volume" :: waited 0.040s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:09 devstack cinder-volume[86981]: INFO oslo.privsep.daemon [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz6vfo3_s/privsep.sock'] Sep 28 18:08:09 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz6vfo3_s/privsep.sock Sep 28 18:08:09 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:08:11 devstack cinder-volume[86981]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 18:08:11 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:11 devstack cinder-volume[86981]: INFO oslo.privsep.daemon [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Spawned new privsep daemon via rootwrap Sep 28 18:08:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Accepted privsep connection to /tmp/tmpz6vfo3_s/privsep.sock {{(pid=86981) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 18:08:11 devstack cinder-volume[86981]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 18:08:11 devstack cinder-volume[86981]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 18:08:11 devstack cinder-volume[86981]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 18:08:11 devstack cinder-volume[86981]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88001 Sep 28 18:08:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3689c4-86ae-415b-b926-4eeab8dd7f17]: (2,) {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab8531c-75b8-4bc4-b172-f81d606b8e81]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:12 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 Sep 28 18:08:12 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:13 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286" returned: 0 in 1.087s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:13 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286 Sep 28 18:08:13 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:13 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d1be1b06-a926-4f57-9e8c-83f984d87286" returned: 0 in 0.565s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Lock "cinder-quobyte-d1be1b06-a926-4f57-9e8c-83f984d87286" released by "delete_volume" :: held 4.082s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:13 devstack cinder-volume[86981]: WARNING cinder.quota [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:13 devstack cinder-volume[86981]: WARNING cinder.quota [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:13 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Created reservations ['d57e90ea-b32f-47ce-8355-7a9eb6bdda03', '52d170da-d0d5-4fb6-b374-a06d48ba1bf9', 'f5df9fb2-67cc-49b6-a359-279beb73bcc2', 'ead24c95-7e6d-4be8-bfab-94d4065bb8ab'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:14 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:08:14 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:14 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.750s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Deleted volume successfully. Sep 28 18:08:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3cb60af8-6ed8-4dc2-8f2c-5807d61be58a tempest-VolumesAdminNegativeTest-983457840 None] Lock "cinder-d1be1b06-a926-4f57-9e8c-83f984d87286-delete_volume" released by "delete_volume" :: held 5.617s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=10,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=6,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Flow 'volume_create_manager' (3569f76d-5054-4497-8119-971786107106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d97cf7f-d22a-4091-a846-583dedde0950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d97cf7f-d22a-4091-a846-583dedde0950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1312085803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed9bffc-3482-4d02-804f-2d46a87d78b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b55011b719942d4a94b0de76f274573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:33Z,use_quota=True,user_id='83d13c607ec341a183d691164ed3544e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d93411-ec26-49b5-88b5-694929bf2b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d93411-ec26-49b5-88b5-694929bf2b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d14f2f-062a-438c-a2fe-aeccb6256849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d14f2f-062a-438c-a2fe-aeccb6256849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed9bffc-3482-4d02-804f-2d46a87d78b1', 'volume_name': 'volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c767bb78-dc2b-4c2f-99d3-d8df5bda95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c767bb78-dc2b-4c2f-99d3-d8df5bda95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dad66f-13fb-4513-861a-a2152d51f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Volume 5ed9bffc-3482-4d02-804f-2d46a87d78b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1', 'volume_size': 1} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1312085803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed9bffc-3482-4d02-804f-2d46a87d78b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b55011b719942d4a94b0de76f274573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:33Z,use_quota=True,user_id='83d13c607ec341a183d691164ed3544e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Creating volume 5ed9bffc-3482-4d02-804f-2d46a87d78b1 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:33 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:33 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 1073741824 Sep 28 18:08:33 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:33 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 1073741824" returned: 0 in 0.672s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:34 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 Sep 28 18:08:34 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:34 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1" returned: 0 in 0.437s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dad66f-13fb-4513-861a-a2152d51f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5ecc9d-d4f9-46a3-9a8d-42fa1f144ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:34 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Volume volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 (5ed9bffc-3482-4d02-804f-2d46a87d78b1): created successfully Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5ecc9d-d4f9-46a3-9a8d-42fa1f144ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Flow 'volume_create_manager' (3569f76d-5054-4497-8119-971786107106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:34 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-27ac2067-11ad-46d3-a2f6-5f1eca425328 tempest-ServerActionsTestOtherA-279123045 None] Created volume successfully. Sep 28 18:08:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:38 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:08:38 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:39 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.521s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:44 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:44 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:09:11 devstack cinder-volume[86981]: WARNING py.warnings [req-83b93eeb-06cf-4cde-b338-ccbe36bf31b0 req-a35301c7-c9e0-45a1-b549-bead7205c587 tempest-TaggedAttachmentsTest-210731958 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 18:09:11 devstack cinder-volume[86981]: .first() Sep 28 18:09:11 devstack cinder-volume[86981]: Sep 28 18:09:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-83b93eeb-06cf-4cde-b338-ccbe36bf31b0 req-a35301c7-c9e0-45a1-b549-bead7205c587 tempest-TaggedAttachmentsTest-210731958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-83b93eeb-06cf-4cde-b338-ccbe36bf31b0 req-a35301c7-c9e0-45a1-b549-bead7205c587 tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-83b93eeb-06cf-4cde-b338-ccbe36bf31b0 req-a35301c7-c9e0-45a1-b549-bead7205c587 tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-83b93eeb-06cf-4cde-b338-ccbe36bf31b0 req-a35301c7-c9e0-45a1-b549-bead7205c587 tempest-TaggedAttachmentsTest-210731958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-f5ea9053-d522-42db-809b-6aad4592e472', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1766278c-ade4-4d7c-ad48-083cf8a728bd', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:09:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-83b93eeb-06cf-4cde-b338-ccbe36bf31b0 req-a35301c7-c9e0-45a1-b549-bead7205c587 tempest-TaggedAttachmentsTest-210731958 None] attachment_update completed successfully. Sep 28 18:09:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-0753e0ae-9886-41af-a780-19874111b8dd req-a697e89f-2857-4a1f-b501-b50dbafaf05c tempest-TaggedAttachmentsTest-210731958 None] Terminate volume connection completed successfully. Sep 28 18:09:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-0753e0ae-9886-41af-a780-19874111b8dd req-a697e89f-2857-4a1f-b501-b50dbafaf05c tempest-TaggedAttachmentsTest-210731958 None] Deleting attachment 1766278c-ade4-4d7c-ad48-083cf8a728bd. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Flow 'volume_create_manager' (3b7a9295-f167-4ca0-96b5-fb705302232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839b97a7-c5de-4533-8769-cef2a0694665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839b97a7-c5de-4533-8769-cef2a0694665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2125445660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe6dde7-bf8c-48bc-91bb-07bd33ef477d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5e6fd2459f4c8cb8cfc4b3354d3d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:20Z,use_quota=True,user_id='cdf9b5b108954629a04a1b7a1145e399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d70090-55a1-4f71-b665-75b53e4ade4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d70090-55a1-4f71-b665-75b53e4ade4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8d4695-cb10-403c-85f5-0a5b68194b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8d4695-cb10-403c-85f5-0a5b68194b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe6dde7-bf8c-48bc-91bb-07bd33ef477d', 'volume_name': 'volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8ccdee-f820-432e-b00e-ace493736484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8ccdee-f820-432e-b00e-ace493736484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e62f87-7e47-4345-a529-0bbc5cd07deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:20 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Volume 3fe6dde7-bf8c-48bc-91bb-07bd33ef477d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d', 'volume_size': 1} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2125445660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe6dde7-bf8c-48bc-91bb-07bd33ef477d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5e6fd2459f4c8cb8cfc4b3354d3d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:20Z,use_quota=True,user_id='cdf9b5b108954629a04a1b7a1145e399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Creating volume 3fe6dde7-bf8c-48bc-91bb-07bd33ef477d {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:20 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:09:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:20 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d 1073741824 Sep 28 18:09:20 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:21 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d 1073741824" returned: 0 in 1.055s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:21 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d Sep 28 18:09:21 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:22 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d" returned: 0 in 0.623s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e62f87-7e47-4345-a529-0bbc5cd07deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b723528-9ce8-4efe-b744-df757ba7bb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:22 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Volume volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d (3fe6dde7-bf8c-48bc-91bb-07bd33ef477d): created successfully Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b723528-9ce8-4efe-b744-df757ba7bb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Flow 'volume_create_manager' (3b7a9295-f167-4ca0-96b5-fb705302232d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c81b6eb3-864e-473f-abec-1fc75920984c tempest-ServersNegativeTestJSON-1181540885 None] Created volume successfully. Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d710fd81-e4bd-49e2-9cfe-21ec24585995 req-df9abb0b-e590-4a83-8c74-fcd0be0f7de4 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d710fd81-e4bd-49e2-9cfe-21ec24585995 req-df9abb0b-e590-4a83-8c74-fcd0be0f7de4 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d710fd81-e4bd-49e2-9cfe-21ec24585995 req-df9abb0b-e590-4a83-8c74-fcd0be0f7de4 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d710fd81-e4bd-49e2-9cfe-21ec24585995 req-df9abb0b-e590-4a83-8c74-fcd0be0f7de4 tempest-ServerActionsTestOtherA-279123045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12bd401c-8ad1-43f6-9a40-2e06a97d6861', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:09:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-d710fd81-e4bd-49e2-9cfe-21ec24585995 req-df9abb0b-e590-4a83-8c74-fcd0be0f7de4 tempest-ServerActionsTestOtherA-279123045 None] attachment_update completed successfully. Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Flow 'volume_create_manager' (79128559-9af5-41d1-b7e7-9c2bb929cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907a945d-9f2a-47ae-91a7-5fe61c874d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907a945d-9f2a-47ae-91a7-5fe61c874d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1930288872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266b342c-555c-47a5-8147-bba8193824f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5e6fd2459f4c8cb8cfc4b3354d3d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:26Z,use_quota=True,user_id='cdf9b5b108954629a04a1b7a1145e399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e53937-cf8a-45af-bfda-7d5f25a540b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e53937-cf8a-45af-bfda-7d5f25a540b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39fc969-37a7-44cb-9f95-a445db7bbb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39fc969-37a7-44cb-9f95-a445db7bbb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266b342c-555c-47a5-8147-bba8193824f2', 'volume_name': 'volume-266b342c-555c-47a5-8147-bba8193824f2', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0abc77d-19ac-461e-b6af-73acc58d3b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0abc77d-19ac-461e-b6af-73acc58d3b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfef6c05-3a98-4b31-932b-e0fddd89f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Volume 266b342c-555c-47a5-8147-bba8193824f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266b342c-555c-47a5-8147-bba8193824f2', 'volume_size': 1} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1930288872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266b342c-555c-47a5-8147-bba8193824f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5e6fd2459f4c8cb8cfc4b3354d3d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:26Z,use_quota=True,user_id='cdf9b5b108954629a04a1b7a1145e399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Creating volume 266b342c-555c-47a5-8147-bba8193824f2 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:26 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:09:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:26 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 1073741824 Sep 28 18:09:26 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:27 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 1073741824" returned: 0 in 0.829s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:27 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 Sep 28 18:09:27 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:28 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2" returned: 0 in 0.458s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfef6c05-3a98-4b31-932b-e0fddd89f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266b342c-555c-47a5-8147-bba8193824f2', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf2b6a4-5b8d-4591-a893-7445185a2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Volume volume-266b342c-555c-47a5-8147-bba8193824f2 (266b342c-555c-47a5-8147-bba8193824f2): created successfully Sep 28 18:09:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf2b6a4-5b8d-4591-a893-7445185a2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Flow 'volume_create_manager' (79128559-9af5-41d1-b7e7-9c2bb929cb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-78b2ba9f-37c2-4daf-8225-f4cf8212e240 tempest-ServersNegativeTestJSON-1181540885 None] Created volume successfully. Sep 28 18:09:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-d0838b92-6721-491f-a357-4f5c91693d59 req-290a0203-f92f-48bc-abf1-8d47886372ca tempest-ServerActionsTestOtherA-279123045 None] Terminate volume connection completed successfully. Sep 28 18:09:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d0838b92-6721-491f-a357-4f5c91693d59 req-290a0203-f92f-48bc-abf1-8d47886372ca tempest-ServerActionsTestOtherA-279123045 None] Deleting attachment 12bd401c-8ad1-43f6-9a40-2e06a97d6861. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:09:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "cinder-266b342c-555c-47a5-8147-bba8193824f2-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-266b342c-555c-47a5-8147-bba8193824f2-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "cinder-quobyte-266b342c-555c-47a5-8147-bba8193824f2" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-quobyte-266b342c-555c-47a5-8147-bba8193824f2" acquired by "delete_volume" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:31 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceae9ef1-b62b-4957-8506-3bbe010e991b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:31 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 Sep 28 18:09:31 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:32 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2" returned: 0 in 1.210s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:32 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2 Sep 28 18:09:32 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d0838b92-6721-491f-a357-4f5c91693d59 req-f90a0545-23a3-4bf8-b6da-6cd94dfb335b tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d0838b92-6721-491f-a357-4f5c91693d59 req-f90a0545-23a3-4bf8-b6da-6cd94dfb335b tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d0838b92-6721-491f-a357-4f5c91693d59 req-f90a0545-23a3-4bf8-b6da-6cd94dfb335b tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d0838b92-6721-491f-a357-4f5c91693d59 req-f90a0545-23a3-4bf8-b6da-6cd94dfb335b tempest-ServerActionsTestOtherA-279123045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4d3d83a-08f3-43c7-ab27-e4372fd47efe', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:09:32 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-266b342c-555c-47a5-8147-bba8193824f2" returned: 0 in 0.483s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:32 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-d0838b92-6721-491f-a357-4f5c91693d59 req-f90a0545-23a3-4bf8-b6da-6cd94dfb335b tempest-ServerActionsTestOtherA-279123045 None] attachment_update completed successfully. Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-quobyte-266b342c-555c-47a5-8147-bba8193824f2" released by "delete_volume" :: held 1.802s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:32 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Created reservations ['69bcadb3-6ae2-4d37-9247-14d84bf0ac1c', '1baca069-dfe6-41d6-b1ea-b29d3c6f4452', 'd773ba4f-67d2-43ea-b408-742db6f0d155', '234fe0ad-dd0f-4834-bc99-a0184a69e2cc'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:33 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:09:33 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "cinder-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:33 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.629s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Deleted volume successfully. Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14fe48b3-64b2-4b93-90df-037900f8dd73 tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-266b342c-555c-47a5-8147-bba8193824f2-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "cinder-quobyte-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-quobyte-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d" acquired by "delete_volume" :: waited 0.073s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bccf2de-47ba-4a47-aca6-50638aa21653]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:34 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d Sep 28 18:09:34 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:34 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d" returned: 0 in 0.692s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:34 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d Sep 28 18:09:34 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:35 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d" returned: 0 in 0.470s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-quobyte-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d" released by "delete_volume" :: held 1.298s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Created reservations ['4edb78a0-1e18-4989-a239-a425ea36ab2c', '9c3da438-a851-43b4-9d15-beabf570c171', 'bc7d587d-03d2-469d-bdf7-426ebb29ead6', 'a006e08d-9514-4c91-8935-c99eaf764420'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Flow 'volume_create_manager' (cf3c9193-023b-4ed3-967c-987885d3a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2a29f8-b7b2-443c-ae34-92e00ff57a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2a29f8-b7b2-443c-ae34-92e00ff57a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-917580738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b9795c-7521-4507-9251-f4e7ca90de21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0324d51077845ffa725d86292e5dd04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:35Z,use_quota=True,user_id='ef8a2877f2ce4d57a15dab77eb520635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6898c05-9f62-4197-9836-32c00607d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6898c05-9f62-4197-9836-32c00607d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9a1f47-8737-45e7-9337-61ccc48f7065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9a1f47-8737-45e7-9337-61ccc48f7065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b9795c-7521-4507-9251-f4e7ca90de21', 'volume_name': 'volume-c1b9795c-7521-4507-9251-f4e7ca90de21', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54502863-26a2-4fa8-baca-39a127e8e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54502863-26a2-4fa8-baca-39a127e8e33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961ffb4e-37a0-4d7b-a9b2-0b2cb09401f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:35 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Volume c1b9795c-7521-4507-9251-f4e7ca90de21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b9795c-7521-4507-9251-f4e7ca90de21', 'volume_size': 1} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-917580738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b9795c-7521-4507-9251-f4e7ca90de21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0324d51077845ffa725d86292e5dd04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:35Z,use_quota=True,user_id='ef8a2877f2ce4d57a15dab77eb520635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Creating volume c1b9795c-7521-4507-9251-f4e7ca90de21 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:35 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:35 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 1073741824 Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:35 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:35 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:09:35 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 1.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Deleted volume successfully. Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 1073741824" returned: 0 in 1.455s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-765c54a4-abe7-4aef-812b-b281442dd28f tempest-ServersNegativeTestJSON-1181540885 None] Lock "cinder-3fe6dde7-bf8c-48bc-91bb-07bd33ef477d-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:37 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 Sep 28 18:09:37 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21" returned: 0 in 0.574s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961ffb4e-37a0-4d7b-a9b2-0b2cb09401f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b9795c-7521-4507-9251-f4e7ca90de21', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3fa2cd-b83c-4f00-b7e9-7ade2e079a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:37 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Volume volume-c1b9795c-7521-4507-9251-f4e7ca90de21 (c1b9795c-7521-4507-9251-f4e7ca90de21): created successfully Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3fa2cd-b83c-4f00-b7e9-7ade2e079a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Flow 'volume_create_manager' (cf3c9193-023b-4ed3-967c-987885d3a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-09e26f3e-9a4e-4073-afbf-abc752b9659c tempest-DeleteServersTestJSON-997251044 None] Created volume successfully. Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Acquiring lock "cinder-f5ea9053-d522-42db-809b-6aad4592e472-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Lock "cinder-f5ea9053-d522-42db-809b-6aad4592e472-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:38 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:09:38 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Acquiring lock "cinder-quobyte-f5ea9053-d522-42db-809b-6aad4592e472" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Lock "cinder-quobyte-f5ea9053-d522-42db-809b-6aad4592e472" acquired by "delete_volume" :: waited 0.058s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c9449d-dade-4eec-a50b-ec75e2fd38a9]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:39 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 Sep 28 18:09:39 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:39 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.978s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 8 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:09:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:09:40 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472" returned: 0 in 1.231s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:40 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472 Sep 28 18:09:40 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:41 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f5ea9053-d522-42db-809b-6aad4592e472" returned: 0 in 0.701s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Lock "cinder-quobyte-f5ea9053-d522-42db-809b-6aad4592e472" released by "delete_volume" :: held 2.068s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d96ef868-e6b0-4569-8404-abbe8c024887 req-2aa9f379-c11d-4aa9-8acf-ed96c43ccc0b tempest-DeleteServersTestJSON-997251044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d96ef868-e6b0-4569-8404-abbe8c024887 req-2aa9f379-c11d-4aa9-8acf-ed96c43ccc0b tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Created reservations ['3476f037-d4ce-4d02-999c-8fc5c29fa73b', '156d125f-db72-42fe-a66f-bb5f53f0c990', '56c88c46-94c6-42ee-89a6-cfc101a09d09', '80611584-2d5e-42ac-b2d6-c01b2a7be4f4'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d96ef868-e6b0-4569-8404-abbe8c024887 req-2aa9f379-c11d-4aa9-8acf-ed96c43ccc0b tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d96ef868-e6b0-4569-8404-abbe8c024887 req-2aa9f379-c11d-4aa9-8acf-ed96c43ccc0b tempest-DeleteServersTestJSON-997251044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-c1b9795c-7521-4507-9251-f4e7ca90de21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d44f45d-5d0d-42a3-8fd3-9cbd7b476a36', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:41 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:09:41 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-d96ef868-e6b0-4569-8404-abbe8c024887 req-2aa9f379-c11d-4aa9-8acf-ed96c43ccc0b tempest-DeleteServersTestJSON-997251044 None] attachment_update completed successfully. Sep 28 18:09:42 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.648s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:42 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Deleted volume successfully. Sep 28 18:09:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bda38eee-6e75-4817-8bbb-bc70862982ac tempest-TaggedAttachmentsTest-210731958 None] Lock "cinder-f5ea9053-d522-42db-809b-6aad4592e472-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-e61c5eef-de39-47a9-b860-8778a32819b1 req-c51642db-7e01-4011-87f9-fc1a72238331 tempest-DeleteServersTestJSON-997251044 None] Terminate volume connection completed successfully. Sep 28 18:09:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-e61c5eef-de39-47a9-b860-8778a32819b1 req-c51642db-7e01-4011-87f9-fc1a72238331 tempest-DeleteServersTestJSON-997251044 None] Deleting attachment 0d44f45d-5d0d-42a3-8fd3-9cbd7b476a36. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:09:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Acquiring lock "cinder-c1b9795c-7521-4507-9251-f4e7ca90de21-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Lock "cinder-c1b9795c-7521-4507-9251-f4e7ca90de21-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Acquiring lock "cinder-quobyte-c1b9795c-7521-4507-9251-f4e7ca90de21" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Lock "cinder-quobyte-c1b9795c-7521-4507-9251-f4e7ca90de21" acquired by "delete_volume" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b58b5-1ab6-4a9b-adfb-5112c8ffc3be]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 Sep 28 18:09:52 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:52 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21" returned: 0 in 0.555s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21 Sep 28 18:09:52 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:53 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c1b9795c-7521-4507-9251-f4e7ca90de21" returned: 0 in 0.400s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Lock "cinder-quobyte-c1b9795c-7521-4507-9251-f4e7ca90de21" released by "delete_volume" :: held 1.067s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Created reservations ['bd573e4a-01eb-4e02-b907-9e4ebf107116', '00472ca8-ba65-4b91-be19-098b4c4cbd82', '430a305f-4d32-4d91-9366-1124e42703d7', '37a20116-8b28-4c1b-9dca-bbc1e65b5a43'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:53 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:09:53 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:53 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.407s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Deleted volume successfully. Sep 28 18:09:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb3de69f-5381-4d24-8526-53fa7cf6edb4 tempest-DeleteServersTestJSON-997251044 None] Lock "cinder-c1b9795c-7521-4507-9251-f4e7ca90de21-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:03 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=54,cinder:UPDATE=44,cinder:DELETE=5,cinder:INSERT=12 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:03 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=56,cinder:UPDATE=50,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dc434a55-acaf-4eb1-8776-efdd4a61bc03 tempest-BackendsCapabilitiesAdminTestsJSON-259244395 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1100692749023, 'free_capacity_gb': 1775.1100692749023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86981) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:10:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-597424f9-5cba-4d70-8c87-6760ec1f0818 tempest-BackendsCapabilitiesAdminTestsJSON-259244395 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1100692749023, 'free_capacity_gb': 1775.1100692749023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86981) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:10:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-20a85ad3-8717-4967-8b5c-7a48fc035334 req-53c36a07-d14c-43e8-b355-e4565df85a85 tempest-ServerActionsTestOtherA-279123045 None] Terminate volume connection completed successfully. Sep 28 18:10:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-20a85ad3-8717-4967-8b5c-7a48fc035334 req-53c36a07-d14c-43e8-b355-e4565df85a85 tempest-ServerActionsTestOtherA-279123045 None] Deleting attachment e4d3d83a-08f3-43c7-ab27-e4372fd47efe. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:10:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-67679b3f-99bd-4d1b-be94-1306db5e1668 tempest-GroupsV314Test-932123805 None] Group tempest-GroupsV314Test-Group-1135206413: creating Sep 28 18:10:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-67679b3f-99bd-4d1b-be94-1306db5e1668 tempest-GroupsV314Test-932123805 None] Group tempest-GroupsV314Test-Group-1135206413: created successfully Sep 28 18:10:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-67679b3f-99bd-4d1b-be94-1306db5e1668 tempest-GroupsV314Test-932123805 None] Create group completed successfully. Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Flow 'volume_create_manager' (8702cf43-31ac-4e18-a510-5d3fbee7e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5fbbba-62c5-4d4d-a336-73de22aefe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5fbbba-62c5-4d4d-a336-73de22aefe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-767171070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40c7aea3-f772-4b2b-b7c1-5b5edac2aa2d,host='devstack@QuobyteHD#QuobyteHD',id=ec751494-d38f-489c-a5fb-9f170c654ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a2113aca414cbb86a5f339450784e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:26Z,use_quota=True,user_id='a7730f5e659c4f6a835b55b17f3e0c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fb005d-db00-452b-98eb-9b3712c43b9f),volume_type_id=13fb005d-db00-452b-98eb-9b3712c43b9f)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f78a4a-1691-4aa4-9cfb-9968ddafd582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f78a4a-1691-4aa4-9cfb-9968ddafd582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86b79f2-5d9a-489f-a336-dbe0a33be797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86b79f2-5d9a-489f-a336-dbe0a33be797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec751494-d38f-489c-a5fb-9f170c654ff9', 'volume_name': 'volume-ec751494-d38f-489c-a5fb-9f170c654ff9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8323fc7-5c20-4a39-8b75-c72e8bf5c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8323fc7-5c20-4a39-8b75-c72e8bf5c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d7e9a8-c3e8-4fee-80f0-c6451e831497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Volume ec751494-d38f-489c-a5fb-9f170c654ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec751494-d38f-489c-a5fb-9f170c654ff9', 'volume_size': 1} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=40c7aea3-f772-4b2b-b7c1-5b5edac2aa2d,created_at=2026-09-28T16:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-767171070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40c7aea3-f772-4b2b-b7c1-5b5edac2aa2d,host='devstack@QuobyteHD#QuobyteHD',id=ec751494-d38f-489c-a5fb-9f170c654ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a2113aca414cbb86a5f339450784e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:26Z,use_quota=True,user_id='a7730f5e659c4f6a835b55b17f3e0c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13fb005d-db00-452b-98eb-9b3712c43b9f),volume_type_id=13fb005d-db00-452b-98eb-9b3712c43b9f)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Creating volume ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:26 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:26 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 1073741824 Sep 28 18:10:26 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:26 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 1073741824" returned: 0 in 0.678s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:26 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 Sep 28 18:10:26 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:27 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d7e9a8-c3e8-4fee-80f0-c6451e831497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec751494-d38f-489c-a5fb-9f170c654ff9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217c7603-7571-4fdf-a791-2e2f736b9e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:27 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Volume volume-ec751494-d38f-489c-a5fb-9f170c654ff9 (ec751494-d38f-489c-a5fb-9f170c654ff9): created successfully Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217c7603-7571-4fdf-a791-2e2f736b9e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Flow 'volume_create_manager' (8702cf43-31ac-4e18-a510-5d3fbee7e413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-771b7325-371e-4bce-bc55-e86d5dd45b45 tempest-GroupsV314Test-932123805 None] Created volume successfully. Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Flow 'volume_create_manager' (32556ad1-4e85-43aa-91d6-afebe21c6bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48abd5aa-909e-4f38-bc37-979bdd4031d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48abd5aa-909e-4f38-bc37-979bdd4031d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1129491261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86adbbce-c63c-426c-9463-43767e277151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b55011b719942d4a94b0de76f274573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:28Z,use_quota=True,user_id='83d13c607ec341a183d691164ed3544e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a67607-b1fb-4c4c-a660-aa9c7e9c361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a67607-b1fb-4c4c-a660-aa9c7e9c361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5920b52-ce4a-49c2-89f4-275e0979e377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:27 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:10:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5920b52-ce4a-49c2-89f4-275e0979e377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86adbbce-c63c-426c-9463-43767e277151', 'volume_name': 'volume-86adbbce-c63c-426c-9463-43767e277151', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd51d07-6386-45e1-82b7-9f96edb96da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd51d07-6386-45e1-82b7-9f96edb96da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaae4ff-d5b5-4c19-a758-fe56b93ee5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:29 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Volume 86adbbce-c63c-426c-9463-43767e277151: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86adbbce-c63c-426c-9463-43767e277151', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:10:29 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Trying to clone 86adbbce-c63c-426c-9463-43767e277151 from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:10:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:29 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Cloning volume ec751494-d38f-489c-a5fb-9f170c654ff9 to volume ac932aac-83ae-44d2-832c-fbacdb072fce Sep 28 18:10:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Creating offline snapshot 272975d5-8277-41ae-880b-30b96f28c1e7 of volume ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:10:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1794f93e-a299-48e1-a149-b07aa087cc53]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:30 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 Sep 28 18:10:30 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:30 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:10:30 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:10:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea3657-734e-4d29-9b2f-7d30e8e6d486]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:30 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD Sep 28 18:10:30 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:30 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9" returned: 0 in 0.917s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:31 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 1G Sep 28 18:10:31 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:31 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:31 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 is fetched for user 83d13c607ec341a183d691164ed3544e. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:10:31 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4677a4-8cf8-417b-87d8-5db214650074]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:31 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD Sep 28 18:10:31 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:31 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 1G" returned: 0 in 0.669s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec751494-d38f-489c-a5fb-9f170c654ff9 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:31 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec751494-d38f-489c-a5fb-9f170c654ff9 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 Sep 28 18:10:31 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:32 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD" returned: 0 in 0.617s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:32 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec751494-d38f-489c-a5fb-9f170c654ff9 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7" returned: 0 in 0.494s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:32 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:10:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:32 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 Sep 28 18:10:32 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:32 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7" returned: 0 in 0.359s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:32 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.info Sep 28 18:10:32 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:33 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.info" returned: 0 in 0.443s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:33 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:33 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.info Sep 28 18:10:33 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:33 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.info" returned: 0 in 0.541s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Acquiring lock "cinder-quobyte-ac932aac-83ae-44d2-832c-fbacdb072fce" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-ac932aac-83ae-44d2-832c-fbacdb072fce" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] snapshot: 272975d5-8277-41ae-880b-30b96f28c1e7, volume: ac932aac-83ae-44d2-832c-fbacdb072fce, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c68b921-9cd0-48c0-93a6-0677bd16f088]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:34 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 Sep 28 18:10:34 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:34 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7" returned: 0 in 0.650s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec751494-d38f-489c-a5fb-9f170c654ff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b07d53-054b-492d-a683-f1299f0f0963]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:34 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 Sep 28 18:10:34 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:34 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9" returned: 0 in 0.495s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:10:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:35 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce Sep 28 18:10:35 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:38 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:10:38 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:39 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.977s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:10:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:10:42 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:42 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:INSERT=3 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:45 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce" returned: 0 in 10.896s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:45 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9, size 1024.00 MB, duration 10.90 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:10:45 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Converted 1024.00 MB image at 93.97 MB/s Sep 28 18:10:45 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:10:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:45 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce Sep 28 18:10:45 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:46 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce" returned: 0 in 0.418s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-ac932aac-83ae-44d2-832c-fbacdb072fce" released by "_copy_volume_from_snapshot" :: held 12.642s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Acquiring lock "cinder-quobyte-272975d5-8277-41ae-880b-30b96f28c1e7" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-272975d5-8277-41ae-880b-30b96f28c1e7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Deleting offline snapshot 272975d5-8277-41ae-880b-30b96f28c1e7 of volume ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] snapshot_file for this snap is: volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8c0120-f64f-437c-8c5a-f3d2608770d5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:46 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 Sep 28 18:10:46 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:47 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7" returned: 0 in 0.580s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec751494-d38f-489c-a5fb-9f170c654ff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:10:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f45ed99-b56c-4160-9c05-2c5dbc33b6b4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:47 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 Sep 28 18:10:47 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:47 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9" returned: 0 in 0.634s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:47 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 Sep 28 18:10:47 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:48 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7" returned: 0 in 0.438s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:48 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7 Sep 28 18:10:48 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:48 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9.272975d5-8277-41ae-880b-30b96f28c1e7" returned: 0 in 0.304s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-272975d5-8277-41ae-880b-30b96f28c1e7" released by "_delete_snapshot" :: held 2.096s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.530s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.458s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1129491261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86adbbce-c63c-426c-9463-43767e277151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b55011b719942d4a94b0de76f274573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:28Z,use_quota=True,user_id='83d13c607ec341a183d691164ed3544e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Creating volume 86adbbce-c63c-426c-9463-43767e277151 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:48 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:10:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:48 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 1073741824 Sep 28 18:10:48 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-76e02856-f4d8-457d-adbb-998c3905bb63 tempest-GroupsV314Test-932123805 None] Create group from source-group-40c7aea3-f772-4b2b-b7c1-5b5edac2aa2d completed successfully. Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Flow 'volume_create_manager' (d113b05d-09ca-4d2d-a520-0a92e5f33157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e952b501-96a2-4fd4-8adb-2a7e7570784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e952b501-96a2-4fd4-8adb-2a7e7570784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-819069782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01f949d-9ead-4dcc-8fae-1f5b1c9613c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ae579973554472ab2fc71d214c1cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:49Z,use_quota=True,user_id='cb79a0ed55144f8fbc7aec87b81fb184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0a29784-7be0-47f7-92b3-03c1bafe99fb),volume_type_id=c0a29784-7be0-47f7-92b3-03c1bafe99fb)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:49 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcc7d04-5263-4781-b007-e40e7e84abe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcc7d04-5263-4781-b007-e40e7e84abe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b560c1-b3e8-4f09-8dcf-0bea4d3b1bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b560c1-b3e8-4f09-8dcf-0bea4d3b1bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01f949d-9ead-4dcc-8fae-1f5b1c9613c1', 'volume_name': 'volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7d18d1-6c3a-422f-9d13-0dc7e416a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7d18d1-6c3a-422f-9d13-0dc7e416a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0c4905-1793-4bac-aea8-d7c32b33900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:49 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Volume b01f949d-9ead-4dcc-8fae-1f5b1c9613c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1', 'volume_size': 1} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 1073741824" returned: 0 in 0.782s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:49 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 Sep 28 18:10:49 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:49 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151" returned: 0 in 0.315s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-819069782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01f949d-9ead-4dcc-8fae-1f5b1c9613c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ae579973554472ab2fc71d214c1cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:49Z,use_quota=True,user_id='cb79a0ed55144f8fbc7aec87b81fb184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0a29784-7be0-47f7-92b3-03c1bafe99fb),volume_type_id=c0a29784-7be0-47f7-92b3-03c1bafe99fb)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Creating volume b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:49 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:49 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 1073741824 Sep 28 18:10:49 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Acquiring lock "cinder-quobyte-ac932aac-83ae-44d2-832c-fbacdb072fce" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Attempting download of 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume 86adbbce-c63c-426c-9463-43767e277151. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-ac932aac-83ae-44d2-832c-fbacdb072fce" acquired by "delete_volume" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf40fdff-35fd-4c37-a088-bfa9ff953ad8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3817826e-ec82-4f85-a2d0-904d911a45b0]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_sh3nh5q0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:50 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce Sep 28 18:10:50 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_sh3nh5q0 Sep 28 18:10:50 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 1073741824" returned: 0 in 0.659s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_sh3nh5q0" returned: 0 in 0.556s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_sh3nh5q0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:50 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 Sep 28 18:10:50 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce" returned: 0 in 0.632s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:50 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce Sep 28 18:10:50 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_sh3nh5q0 Sep 28 18:10:50 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1" returned: 0 in 0.381s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0c4905-1793-4bac-aea8-d7c32b33900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a90670d-43b2-4edf-a432-80baca8716a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:50 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Volume volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 (b01f949d-9ead-4dcc-8fae-1f5b1c9613c1): created successfully Sep 28 18:10:50 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a90670d-43b2-4edf-a432-80baca8716a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Flow 'volume_create_manager' (d113b05d-09ca-4d2d-a520-0a92e5f33157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac932aac-83ae-44d2-832c-fbacdb072fce" returned: 0 in 0.406s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_sh3nh5q0" returned: 1 in 0.457s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_sh3nh5q0' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-ac932aac-83ae-44d2-832c-fbacdb072fce" released by "delete_volume" :: held 1.114s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50cdb9-43da-4ef6-b406-552d07385b58]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:50 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f52b4cb2-203e-4770-9a9b-dbfecd773d5a tempest-VolumeTypesAccessTest-1349061950 None] Created volume successfully. Sep 28 18:10:51 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD Sep 28 18:10:51 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Created reservations ['db5a60d8-ca2c-4321-a3db-9aaf49836412'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:51 devstack cinder-volume[86981]: WARNING cinder.quota [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-962030424 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-962030424, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:10:51 devstack cinder-volume[86981]: WARNING cinder.quota [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-962030424 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-962030424, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Created reservations ['031d949f-5b0d-4979-ad6a-943d7c8c0ca7', 'd3f72a27-7cfa-4d2c-b3d9-c8e1d04f8e57', 'c4e890ed-2ad1-4e6e-a917-01f042567fac', '00b788bd-481d-43ee-86cd-80d03ac2ae1f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:51 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:10:51 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:51 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Acquiring lock "cinder-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] 052187e4-f9b0-4ab2-bf54-351fdb1df836 was qcow2, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Lock "cinder-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:51 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 Sep 28 18:10:51 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Acquiring lock "cinder-quobyte-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Lock "cinder-quobyte-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb4ed11-b7b3-497b-8806-ba563058b648]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:52 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.488s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:52 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-dd57dcdb-6bd4-4c92-a230-9bb5e6eabf50 tempest-GroupsV314Test-932123805 None] Delete group completed successfully. Sep 28 18:10:52 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 Sep 28 18:10:52 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:52 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1" returned: 0 in 0.644s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:52 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1 Sep 28 18:10:52 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:52 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Lock "cinder-quobyte-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1" released by "delete_volume" :: held 1.184s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:53 devstack cinder-volume[86981]: WARNING cinder.quota [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1322647234 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1322647234, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:10:53 devstack cinder-volume[86981]: WARNING cinder.quota [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1322647234 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1322647234, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Acquiring lock "cinder-quobyte-ec751494-d38f-489c-a5fb-9f170c654ff9" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Created reservations ['6b913828-4bf5-471d-909e-e09ef28014b0', 'b84a287f-d3ea-4150-b37c-ec5589d95f0a', 'd45de463-b4c2-4c7a-a52c-92f65dea0ce3', '539d65f7-45ec-47bb-b8fc-fedf65682a16'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-ec751494-d38f-489c-a5fb-9f170c654ff9" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[961df51c-205e-45df-b4c2-8c192845b420]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:10:53 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 Sep 28 18:10:53 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.373s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Deleted volume successfully. Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4facd743-8b57-49cb-8b14-35dc93b42cea tempest-VolumeTypesAccessTest-1349061950 None] Lock "cinder-b01f949d-9ead-4dcc-8fae-1f5b1c9613c1-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:53 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9" returned: 0 in 0.555s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9 Sep 28 18:10:53 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec751494-d38f-489c-a5fb-9f170c654ff9" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Lock "cinder-quobyte-ec751494-d38f-489c-a5fb-9f170c654ff9" released by "delete_volume" :: held 1.149s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Created reservations ['f73218e6-1340-40fe-9889-310281071336'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:54 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Created reservations ['a28d939d-8665-4552-bb74-ecc1337d182b', 'ad95c3ac-74e3-4997-aa72-5e4da16b7c61', '8b6623ad-1584-4f4f-8532-ac3d2d3f0dcd', '7ae91224-3e61-4747-84b8-ceb4a7b13c4c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151" returned: 0 in 2.806s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_isiohdoydevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:10:54 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Converted 112.00 MB image at 39.89 MB/s Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:54 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 1G Sep 28 18:10:54 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:54 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:10:54 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 1G" returned: 0 in 0.507s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Downloaded image 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume 86adbbce-c63c-426c-9463-43767e277151 successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 for user 83d13c607ec341a183d691164ed3544e is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:10:54 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Marking volume 86adbbce-c63c-426c-9463-43767e277151 as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:10:54 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.372s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-30ba5e37-0951-4e7c-817c-87b23125f696 tempest-GroupsV314Test-932123805 None] Delete group completed successfully. Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Copying metadata from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 to 86adbbce-c63c-426c-9463-43767e277151. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Creating volume glance metadata for volume 86adbbce-c63c-426c-9463-43767e277151 backed by image 052187e4-f9b0-4ab2-bf54-351fdb1df836 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaae4ff-d5b5-4c19-a758-fe56b93ee5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86adbbce-c63c-426c-9463-43767e277151', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a438bf8-56be-4b03-b8f3-bfa9c6d2ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:55 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Volume volume-86adbbce-c63c-426c-9463-43767e277151 (86adbbce-c63c-426c-9463-43767e277151): created successfully Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a438bf8-56be-4b03-b8f3-bfa9c6d2ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Flow 'volume_create_manager' (32556ad1-4e85-43aa-91d6-afebe21c6bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c91fc685-d32b-4a62-908d-1a29e156e610 tempest-ServerActionsTestOtherA-279123045 None] Created volume successfully. Sep 28 18:10:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-868c8ac4-4f10-4203-9b69-dbbe80847196 req-d79ae03d-3920-4dea-af34-10de4a8c71d8 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-868c8ac4-4f10-4203-9b69-dbbe80847196 req-d79ae03d-3920-4dea-af34-10de4a8c71d8 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-868c8ac4-4f10-4203-9b69-dbbe80847196 req-d79ae03d-3920-4dea-af34-10de4a8c71d8 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-868c8ac4-4f10-4203-9b69-dbbe80847196 req-d79ae03d-3920-4dea-af34-10de4a8c71d8 tempest-ServerActionsTestOtherA-279123045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-86adbbce-c63c-426c-9463-43767e277151', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7152ed6-0fb5-4160-9e75-6ad7292fb8b7', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:11:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-868c8ac4-4f10-4203-9b69-dbbe80847196 req-d79ae03d-3920-4dea-af34-10de4a8c71d8 tempest-ServerActionsTestOtherA-279123045 None] attachment_update completed successfully. Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Flow 'volume_create_manager' (2033a1f6-2bb0-4612-a5ff-06f6ae440525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843c2e4b-bb35-4354-99bc-5185a36ed245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843c2e4b-bb35-4354-99bc-5185a36ed245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-62742002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6def24f8-79ae-47d4-a028-d3247fc30c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904f3831dc584254b8a401e43781a6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:06Z,use_quota=True,user_id='7aea6efc1e2e4defb536a169a318e996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21db8599-0c0f-41f3-8c15-4e714329d666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21db8599-0c0f-41f3-8c15-4e714329d666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d17335-4fdc-402c-ae79-f98aa942946c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d17335-4fdc-402c-ae79-f98aa942946c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6def24f8-79ae-47d4-a028-d3247fc30c60', 'volume_name': 'volume-6def24f8-79ae-47d4-a028-d3247fc30c60', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c94dfa-2e69-42b0-bc38-81524ed2147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c94dfa-2e69-42b0-bc38-81524ed2147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffa6e7c-1325-440e-b69f-5164537ed9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:05 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Volume 6def24f8-79ae-47d4-a028-d3247fc30c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6def24f8-79ae-47d4-a028-d3247fc30c60', 'volume_size': 1} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-62742002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6def24f8-79ae-47d4-a028-d3247fc30c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904f3831dc584254b8a401e43781a6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:06Z,use_quota=True,user_id='7aea6efc1e2e4defb536a169a318e996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Creating volume 6def24f8-79ae-47d4-a028-d3247fc30c60 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:05 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:11:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:05 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 1073741824 Sep 28 18:11:05 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:06 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 1073741824" returned: 0 in 0.781s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:06 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 Sep 28 18:11:06 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:07 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffa6e7c-1325-440e-b69f-5164537ed9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6def24f8-79ae-47d4-a028-d3247fc30c60', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f7535d-de29-4b8d-8578-633ba691f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:07 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Volume volume-6def24f8-79ae-47d4-a028-d3247fc30c60 (6def24f8-79ae-47d4-a028-d3247fc30c60): created successfully Sep 28 18:11:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f7535d-de29-4b8d-8578-633ba691f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Flow 'volume_create_manager' (2033a1f6-2bb0-4612-a5ff-06f6ae440525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f5cd6573-be47-4b3f-9dc2-f2530fffd0e5 tempest-AttachVolumeShelveTestJSON-577828968 None] Created volume successfully. Sep 28 18:11:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3e91eab8-6577-486e-953d-8b6c74d02fdf tempest-GroupsV320Test-1273131697 None] Group tempest-GroupsV320Test-Group-583599804: creating Sep 28 18:11:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3e91eab8-6577-486e-953d-8b6c74d02fdf tempest-GroupsV320Test-1273131697 None] Group tempest-GroupsV320Test-Group-583599804: created successfully Sep 28 18:11:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3e91eab8-6577-486e-953d-8b6c74d02fdf tempest-GroupsV320Test-1273131697 None] Create group completed successfully. Sep 28 18:11:09 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Created reservations ['fb4fee21-48cd-4c40-825d-264e428aa55b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:10 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:11:10 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:10 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.763s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:10 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:10 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f4a5c17a-9396-4af0-a3ed-cae2a0476535 tempest-GroupsV320Test-1273131697 None] Delete group completed successfully. Sep 28 18:11:19 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=46,cinder:SELECT=42,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:19 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=49,cinder:SELECT=53,cinder:INSERT=16,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-dc89c434-7a11-40c6-a1d4-a4b886ae41d5 req-7349e364-1a17-4fb1-a173-67fdb43b44fd tempest-AttachVolumeShelveTestJSON-577828968 None] No connector for attachment f49272ab-3756-4762-a3e3-ffe9a6028d02; skipping storage backend terminate_connection call. {{(pid=86981) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 18:11:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-dc89c434-7a11-40c6-a1d4-a4b886ae41d5 req-7349e364-1a17-4fb1-a173-67fdb43b44fd tempest-AttachVolumeShelveTestJSON-577828968 None] Deleting attachment f49272ab-3756-4762-a3e3-ffe9a6028d02. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:11:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-03e98615-4cc8-48fc-b51a-583550322463 req-a6984a75-1ea6-4af0-852d-575598962146 tempest-ServerActionsTestOtherA-279123045 None] Terminate volume connection completed successfully. Sep 28 18:11:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-03e98615-4cc8-48fc-b51a-583550322463 req-a6984a75-1ea6-4af0-852d-575598962146 tempest-ServerActionsTestOtherA-279123045 None] Deleting attachment b7152ed6-0fb5-4160-9e75-6ad7292fb8b7. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:11:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:38 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:11:38 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:39 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.494s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:11:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:11:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-03e98615-4cc8-48fc-b51a-583550322463 req-a076f75b-3db0-431b-990c-ce91d7984715 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-03e98615-4cc8-48fc-b51a-583550322463 req-a076f75b-3db0-431b-990c-ce91d7984715 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-03e98615-4cc8-48fc-b51a-583550322463 req-a076f75b-3db0-431b-990c-ce91d7984715 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-03e98615-4cc8-48fc-b51a-583550322463 req-a076f75b-3db0-431b-990c-ce91d7984715 tempest-ServerActionsTestOtherA-279123045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-86adbbce-c63c-426c-9463-43767e277151', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '495bfda5-62d5-4552-9e45-3d8a36125083', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:11:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-03e98615-4cc8-48fc-b51a-583550322463 req-a076f75b-3db0-431b-990c-ce91d7984715 tempest-ServerActionsTestOtherA-279123045 None] attachment_update completed successfully. Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Flow 'volume_create_manager' (e885bce1-6ba1-445e-89b2-adfa32c974bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676886bf-0173-45d5-88e9-74867eb92279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676886bf-0173-45d5-88e9-74867eb92279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1716872317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0c8204-b9ec-44f1-8700-77fe43d0f050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4454e049fbf849d282f42b50c3b15b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:43Z,use_quota=True,user_id='c5800a44bd7d42aeba5cdca61a561036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2e2a82-521b-482f-9fbb-21ed0a9c5b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2e2a82-521b-482f-9fbb-21ed0a9c5b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f273bd9b-ea40-4fa8-b576-4ba151a8e4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f273bd9b-ea40-4fa8-b576-4ba151a8e4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0c8204-b9ec-44f1-8700-77fe43d0f050', 'volume_name': 'volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a39878d-ba7c-416b-be94-e77de76c8aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a39878d-ba7c-416b-be94-e77de76c8aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71455a74-eee8-4f94-bf84-22810d7149e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:42 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050', 'volume_size': 1} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1716872317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0c8204-b9ec-44f1-8700-77fe43d0f050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4454e049fbf849d282f42b50c3b15b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:43Z,use_quota=True,user_id='c5800a44bd7d42aeba5cdca61a561036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Creating volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:42 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:11:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:42 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 1073741824 Sep 28 18:11:42 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:43 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 1073741824" returned: 0 in 0.922s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:43 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 Sep 28 18:11:43 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:44 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050" returned: 0 in 0.516s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71455a74-eee8-4f94-bf84-22810d7149e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7270b2b-546d-4bb2-b69a-00e6adfde0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:44 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Volume volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 (0d0c8204-b9ec-44f1-8700-77fe43d0f050): created successfully Sep 28 18:11:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7270b2b-546d-4bb2-b69a-00e6adfde0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Flow 'volume_create_manager' (e885bce1-6ba1-445e-89b2-adfa32c974bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:44 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7635dce5-e71d-400e-b80a-b60b2ef68b53 tempest-SnapshotsActionsTest-714478928 None] Created volume successfully. Sep 28 18:11:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Creating offline snapshot a1ce2517-068e-4195-8984-42e6f4ad7ea1 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:11:45 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7994e57-d851-4ba1-9798-921e8f640ca4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:45 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 Sep 28 18:11:45 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:46 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050" returned: 0 in 0.890s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:46 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 1G Sep 28 18:11:46 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:47 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 1G" returned: 0 in 1.409s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:47 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:11:47 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:48 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 1.044s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:48 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 is being set with open permissions: ugo+rw Sep 28 18:11:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:48 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:11:48 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:49 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.725s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:49 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.info Sep 28 18:11:49 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:50 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.info" returned: 0 in 0.707s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:50 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.info is being set with open permissions: ugo+rw Sep 28 18:11:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:50 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.info Sep 28 18:11:50 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:50 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.info" returned: 0 in 0.482s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.526s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:50 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6ff18bb4-997f-4b24-b274-55797cac69ea tempest-SnapshotsActionsTest-714478928 None] Create snapshot completed successfully Sep 28 18:11:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Creating offline snapshot 249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:11:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a6dd9-343e-411c-bf7a-d78637723244]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:11:54 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:54 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.993s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb 1G Sep 28 18:11:54 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:57 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb 1G" returned: 0 in 2.218s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:57 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb Sep 28 18:11:57 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" returned: 0 in 1.178s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:58 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb is being set with open permissions: ugo+rw Sep 28 18:11:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:58 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb Sep 28 18:11:58 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:59 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" returned: 0 in 0.824s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.531s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:59 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c28a6e84-66f8-4c1e-83cb-1270156d30f5 tempest-SnapshotsActionsTest-714478928 None] Create snapshot completed successfully Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Deleting offline snapshot 249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] snapshot_file for this snap is: volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[67082ca7-4ef2-4c0a-b642-7fe1f4eb1d9e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:01 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb Sep 28 18:12:01 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:02 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" returned: 0 in 1.208s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a57ca5-fee7-47ff-b2d3-1470fbc10d11]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:03 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:03 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:03 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 1.008s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:03 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb Sep 28 18:12:03 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:04 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" returned: 0 in 0.798s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:04 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb Sep 28 18:12:04 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:04 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" returned: 0 in 0.436s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb" released by "_delete_snapshot" :: held 3.813s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" released by "delete_snapshot" :: held 3.870s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:05 devstack cinder-volume[86981]: WARNING cinder.quota [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:05 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Created reservations ['77bc1651-bdf1-4f8c-a655-061907429483', 'caa3956d-d1b3-44b7-a5bf-d0d9b86ac1f0', '343e7223-3e60-4757-8e35-deae2a01ad52', '25fcc3c8-3a6e-4234-9315-f4aee765b3c3'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:05 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Delete snapshot completed successfully. Sep 28 18:12:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0980820a-0bda-489d-bc70-657c2468b409 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-249ce2af-dd7e-4a0f-9ef3-cf665f7c4dcb-delete_snapshot" released by "delete_snapshot" :: held 4.448s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Creating offline snapshot af62bf77-0432-41f6-9686-7b69b47e6340 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc498d-b9fb-4762-8eed-89ee79cd3096]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:07 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:07 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:08 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.990s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:08 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 1G Sep 28 18:12:08 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:08 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 1G" returned: 0 in 0.755s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:08 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 Sep 28 18:12:08 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:09 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340" returned: 0 in 0.592s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:09 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 is being set with open permissions: ugo+rw Sep 28 18:12:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:09 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 Sep 28 18:12:09 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:09 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fdbb94e6-b819-470f-b7af-d85c25c0f92d tempest-SnapshotsActionsTest-714478928 None] Create snapshot completed successfully Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-af62bf77-0432-41f6-9686-7b69b47e6340-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-af62bf77-0432-41f6-9686-7b69b47e6340-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-af62bf77-0432-41f6-9686-7b69b47e6340" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-af62bf77-0432-41f6-9686-7b69b47e6340" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Deleting offline snapshot af62bf77-0432-41f6-9686-7b69b47e6340 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] snapshot_file for this snap is: volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d57901-5fdd-42c9-a6b1-4fe16a315c8e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (4d7ab1e0-6c7c-42b3-ac52-26da8181de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8138641-2951-4a1e-8d37-5413be335df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 Sep 28 18:12:11 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8138641-2951-4a1e-8d37-5413be335df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-224921464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc99457d-afc4-44aa-b29c-7d9348726280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:12Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351cceda-7b68-44d7-b8d8-d11fda96f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351cceda-7b68-44d7-b8d8-d11fda96f90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880e4c25-a961-4084-8d5f-efc0c56acde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880e4c25-a961-4084-8d5f-efc0c56acde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc99457d-afc4-44aa-b29c-7d9348726280', 'volume_name': 'volume-bc99457d-afc4-44aa-b29c-7d9348726280', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df167bb0-b417-4512-a912-4c5d7cff0e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df167bb0-b417-4512-a912-4c5d7cff0e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8bb6a1-7dac-401e-b9a9-bb4e81c13ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Volume bc99457d-afc4-44aa-b29c-7d9348726280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc99457d-afc4-44aa-b29c-7d9348726280', 'volume_size': 1} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-224921464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc99457d-afc4-44aa-b29c-7d9348726280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:12Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Creating volume bc99457d-afc4-44aa-b29c-7d9348726280 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:11 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:11 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 1073741824 Sep 28 18:12:11 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:12 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340" returned: 0 in 0.618s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9293ff6-0174-4811-91a9-c4863fb8dc7a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:12 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:12 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:12 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 1073741824" returned: 0 in 0.778s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:12 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 Sep 28 18:12:12 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:12 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.586s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:12 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 Sep 28 18:12:12 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:13 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8bb6a1-7dac-401e-b9a9-bb4e81c13ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc99457d-afc4-44aa-b29c-7d9348726280', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4dbe91-2dee-4880-a569-edef9acc3397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Volume volume-bc99457d-afc4-44aa-b29c-7d9348726280 (bc99457d-afc4-44aa-b29c-7d9348726280): created successfully Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4dbe91-2dee-4880-a569-edef9acc3397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (4d7ab1e0-6c7c-42b3-ac52-26da8181de2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-06c0ac44-3429-44b4-953c-dffd137c3c23 tempest-VolumesActionsTest-1537575616 None] Created volume successfully. Sep 28 18:12:13 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340" returned: 0 in 0.640s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:13 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340 Sep 28 18:12:13 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-92d6849b-414c-4552-88a9-1d1f5ca8eb09 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280" by "attach_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-92d6849b-414c-4552-88a9-1d1f5ca8eb09 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280" acquired by "attach_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-92d6849b-414c-4552-88a9-1d1f5ca8eb09 tempest-VolumesActionsTest-1537575616 None] Attaching volume bc99457d-afc4-44aa-b29c-7d9348726280 to instance eef52e11-a130-4f95-b6e5-469dbb9ef02e at mountpoint /dev/vdb on host None. Sep 28 18:12:13 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.af62bf77-0432-41f6-9686-7b69b47e6340" returned: 0 in 0.484s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-af62bf77-0432-41f6-9686-7b69b47e6340" released by "_delete_snapshot" :: held 2.478s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" released by "delete_snapshot" :: held 2.562s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-92d6849b-414c-4552-88a9-1d1f5ca8eb09 tempest-VolumesActionsTest-1537575616 None] Attach volume completed successfully. Sep 28 18:12:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-92d6849b-414c-4552-88a9-1d1f5ca8eb09 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280" released by "attach_volume" :: held 0.214s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:14 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Created reservations ['f9130fb0-82cb-492b-b548-83f94ba38e5b', 'cd0b294b-58c3-493a-a1a9-565ac8040961', 'd32dbdf5-63a3-4ca2-b696-76817eca54a5', '68bcb092-6f8f-4935-abc7-7e88e29dfabc'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Delete snapshot completed successfully. Sep 28 18:12:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce91d0e9-d77b-4631-b87b-93843cbc06c3 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-af62bf77-0432-41f6-9686-7b69b47e6340-delete_snapshot" released by "delete_snapshot" :: held 2.853s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-70363bfa-141f-4dc7-bdf7-cb57d3db117c tempest-VolumesActionsTest-728427353 None] Terminate volume connection completed successfully. Sep 28 18:12:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70363bfa-141f-4dc7-bdf7-cb57d3db117c tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-detach_volume" by "detach_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70363bfa-141f-4dc7-bdf7-cb57d3db117c tempest-VolumesActionsTest-728427353 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-70363bfa-141f-4dc7-bdf7-cb57d3db117c tempest-VolumesActionsTest-728427353 None] Detaching volume bc99457d-afc4-44aa-b29c-7d9348726280 from instance eef52e11-a130-4f95-b6e5-469dbb9ef02e. Sep 28 18:12:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-70363bfa-141f-4dc7-bdf7-cb57d3db117c tempest-VolumesActionsTest-728427353 None] Detach volume completed successfully. Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70363bfa-141f-4dc7-bdf7-cb57d3db117c tempest-VolumesActionsTest-728427353 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Creating offline snapshot eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8910b1dd-2a2a-4f9a-916d-826b12fca191 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-detach_volume" by "detach_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec574ab-da1e-4bf7-b9a7-89707ffa6032]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8910b1dd-2a2a-4f9a-916d-826b12fca191 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8910b1dd-2a2a-4f9a-916d-826b12fca191 tempest-VolumesActionsTest-1537575616 None] Volume detach called, but volume not attached. Sep 28 18:12:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8910b1dd-2a2a-4f9a-916d-826b12fca191 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:15 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:15 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Acquiring lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Acquiring lock "cinder-quobyte-bc99457d-afc4-44aa-b29c-7d9348726280" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Lock "cinder-quobyte-bc99457d-afc4-44aa-b29c-7d9348726280" acquired by "delete_volume" :: waited 0.055s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b100c92-a404-4b91-a59e-16a8b267cce7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:16 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.871s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:16 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 1G Sep 28 18:12:16 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 Sep 28 18:12:16 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280" returned: 0 in 0.743s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280 Sep 28 18:12:17 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 1G" returned: 0 in 1.104s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 Sep 28 18:12:17 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bc99457d-afc4-44aa-b29c-7d9348726280" returned: 0 in 0.577s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Lock "cinder-quobyte-bc99457d-afc4-44aa-b29c-7d9348726280" released by "delete_volume" :: held 1.448s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Created reservations ['71baa6cb-6f1d-4254-8437-d42f7328e9fa', 'db74fe34-5909-480f-b691-35d37ca60787', '95f97973-efbd-41d3-bf29-4a9bf223e10c', 'b6fb9114-8450-4785-8c15-d7983846a608'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:17 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:18 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" returned: 0 in 0.595s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 is being set with open permissions: ugo+rw Sep 28 18:12:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:18 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 Sep 28 18:12:18 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:18 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.414s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Deleted volume successfully. Sep 28 18:12:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-91b59457-6090-4a11-bcda-2110a449ad5d tempest-VolumesActionsTest-1537575616 None] Lock "cinder-bc99457d-afc4-44aa-b29c-7d9348726280-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:18 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" returned: 0 in 0.560s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e7f1f8f5-84aa-4a15-bb0a-9efc4972e158 tempest-SnapshotsActionsTest-714478928 None] Create snapshot completed successfully Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-eadada7f-2e3c-4e0b-b827-9fdd804a6fa4-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-eadada7f-2e3c-4e0b-b827-9fdd804a6fa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Deleting offline snapshot eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] snapshot_file for this snap is: volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[23953d0f-5780-484b-aed0-51b8d56eabf6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:20 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 Sep 28 18:12:20 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:20 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" returned: 0 in 0.623s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc1a3a7-1981-46bd-8b71-ec99d354c4a2]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:20 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:20 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:21 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.586s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 Sep 28 18:12:21 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:21 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" returned: 0 in 0.598s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4 Sep 28 18:12:21 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:22 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" returned: 0 in 0.340s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-eadada7f-2e3c-4e0b-b827-9fdd804a6fa4" released by "_delete_snapshot" :: held 2.298s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" released by "delete_snapshot" :: held 2.342s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:22 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Created reservations ['73a19ebd-6089-414b-93db-bb70628fbaa9', '4be31a69-e121-466d-8b93-6ba1c50b1011', 'bd07e97c-4e27-48f6-8cd5-4a70456cc5f6', 'd81e8fbb-edf2-4748-b49e-4bd5fd491a1a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Delete snapshot completed successfully. Sep 28 18:12:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4cd0a7ae-f39c-45f4-ae5d-1b3e2702adb7 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-eadada7f-2e3c-4e0b-b827-9fdd804a6fa4-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (64faa7ad-4828-4ff4-84ee-dbcab39d5aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bed978-bb5f-4a2f-9e1e-77035d88fb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bed978-bb5f-4a2f-9e1e-77035d88fb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1878335166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b01e6d-92d1-4404-ac99-720df6d72765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:24Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f41b8a-fa43-49c0-ab17-40bb57cd445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f41b8a-fa43-49c0-ab17-40bb57cd445d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed54870e-6d30-4270-8c42-8bd411b3e31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed54870e-6d30-4270-8c42-8bd411b3e31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b01e6d-92d1-4404-ac99-720df6d72765', 'volume_name': 'volume-d3b01e6d-92d1-4404-ac99-720df6d72765', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21fa907-281b-4f0b-bca0-ea86b57f2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21fa907-281b-4f0b-bca0-ea86b57f2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd49588e-b2de-4e36-b246-14ed11711f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:23 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Volume d3b01e6d-92d1-4404-ac99-720df6d72765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b01e6d-92d1-4404-ac99-720df6d72765', 'volume_size': 1} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1878335166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b01e6d-92d1-4404-ac99-720df6d72765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:24Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Creating volume d3b01e6d-92d1-4404-ac99-720df6d72765 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:23 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:23 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 1073741824 Sep 28 18:12:23 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:24 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 1073741824" returned: 0 in 0.763s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:24 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 Sep 28 18:12:24 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:24 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765" returned: 0 in 0.333s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.125s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd49588e-b2de-4e36-b246-14ed11711f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b01e6d-92d1-4404-ac99-720df6d72765', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54c60ef-438d-4e43-9dbb-a4abe56ec192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Creating offline snapshot 22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:25 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Volume volume-d3b01e6d-92d1-4404-ac99-720df6d72765 (d3b01e6d-92d1-4404-ac99-720df6d72765): created successfully Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54c60ef-438d-4e43-9dbb-a4abe56ec192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (64faa7ad-4828-4ff4-84ee-dbcab39d5aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225b8c5-df9c-498c-b03c-1d79f75ddd08]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2ea27b8f-810c-473f-805d-31f75639ebee tempest-VolumesActionsTest-1537575616 None] Created volume successfully. Sep 28 18:12:25 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:25 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-81e74679-a5d4-4a8e-bfcd-bf6fed2f79c4 tempest-ServerActionsTestOtherA-279123045 None] Terminate volume connection completed successfully. Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-81e74679-a5d4-4a8e-bfcd-bf6fed2f79c4 tempest-ServerActionsTestOtherA-279123045 None] Deleting attachment 495bfda5-62d5-4552-9e45-3d8a36125083. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:12:25 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.597s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 1G Sep 28 18:12:25 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "cinder-86adbbce-c63c-426c-9463-43767e277151-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-86adbbce-c63c-426c-9463-43767e277151-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "cinder-quobyte-86adbbce-c63c-426c-9463-43767e277151" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-quobyte-86adbbce-c63c-426c-9463-43767e277151" acquired by "delete_volume" :: waited 0.038s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-d3b01e6d-92d1-4404-ac99-720df6d72765-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4415c05f-31ea-48a8-a5fc-f0e6519abb33]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Lock "cinder-d3b01e6d-92d1-4404-ac99-720df6d72765-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-quobyte-d3b01e6d-92d1-4404-ac99-720df6d72765" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-d3b01e6d-92d1-4404-ac99-720df6d72765" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[af425cc4-a0fb-48b3-af01-d2deb7458459]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 Sep 28 18:12:26 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 1G" returned: 0 in 0.800s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 Sep 28 18:12:26 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 Sep 28 18:12:26 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151" returned: 0 in 0.543s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151 Sep 28 18:12:26 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" returned: 0 in 0.445s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 is being set with open permissions: ugo+rw Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765" returned: 0 in 0.536s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 Sep 28 18:12:26 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765 Sep 28 18:12:26 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:27 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-86adbbce-c63c-426c-9463-43767e277151" returned: 0 in 0.348s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-quobyte-86adbbce-c63c-426c-9463-43767e277151" released by "delete_volume" :: held 0.997s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.quota [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Created reservations ['070c1174-1550-426c-b0b3-60c624939a81', 'e80c839d-3034-4491-8485-21945b78b93c', '79877945-7c59-42a6-b6f3-87ee98a22680', 'ef5eeb47-3e87-4428-9b7e-21c90b037e83'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:27 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:27 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" returned: 0 in 0.348s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3b01e6d-92d1-4404-ac99-720df6d72765" returned: 0 in 0.349s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-d3b01e6d-92d1-4404-ac99-720df6d72765" released by "delete_volume" :: held 0.997s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a86a9a3b-f02a-447d-a0a0-92a2ed7756ff tempest-SnapshotsActionsTest-714478928 None] Create snapshot completed successfully Sep 28 18:12:27 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:27 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "cinder-5ed9bffc-3482-4d02-804f-2d46a87d78b1-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-5ed9bffc-3482-4d02-804f-2d46a87d78b1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "cinder-quobyte-5ed9bffc-3482-4d02-804f-2d46a87d78b1" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Created reservations ['f2370876-71a4-4980-83d6-39d213c5b74b', '21d73b59-0462-4602-9d72-ae56484e26f5', '7235e6de-a1bf-469a-b455-6c4dbe1645bd', '04ff8663-7e23-4a33-9fbb-432eec34f44a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-quobyte-5ed9bffc-3482-4d02-804f-2d46a87d78b1" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5470ac96-9f50-4e0c-abd7-c89107d16e54]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:27 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:27 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:27 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 Sep 28 18:12:27 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:27 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.manager [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Deleted volume successfully. Sep 28 18:12:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-c6a48a90-bc1f-4841-b79c-b1421926569a req-eee06710-61c9-4f2a-ae19-eca4d6d1f6a7 tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-86adbbce-c63c-426c-9463-43767e277151-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-22d5ca4a-df2d-4d7c-8204-0004ba8f4c66-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:28 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.300s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-22d5ca4a-df2d-4d7c-8204-0004ba8f4c66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Deleted volume successfully. Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Acquiring lock "cinder-quobyte-22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e5fdbc8f-245f-4432-8707-f086aa3be909 tempest-VolumesActionsTest-728427353 None] Lock "cinder-d3b01e6d-92d1-4404-ac99-720df6d72765-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Deleting offline snapshot 22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] snapshot_file for this snap is: volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce128d-88a0-4df1-a168-0a48ade90750]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:28 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1" returned: 0 in 0.533s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:28 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1 Sep 28 18:12:28 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:28 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 Sep 28 18:12:28 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:28 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ed9bffc-3482-4d02-804f-2d46a87d78b1" returned: 0 in 0.305s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-quobyte-5ed9bffc-3482-4d02-804f-2d46a87d78b1" released by "delete_volume" :: held 0.909s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Created reservations ['77fc5c1a-99e7-42fa-b736-6e9c5afa7cc9', 'ea141098-14b2-49c0-ab7e-6c8703ddb403', 'ec4189e9-2736-43b6-93b9-b393bcd2eb36', '69b4c38d-8a22-467c-9e4e-52abcf544b42'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:28 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" returned: 0 in 0.502s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[801b34bc-8586-4c0b-b345-e200ec65233a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:28 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:28 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:28 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:28 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:29 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.345s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:29 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Deleted volume successfully. Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9f4e2471-0e71-4be2-a0d5-589598ef564c tempest-ServerActionsTestOtherA-279123045 None] Lock "cinder-5ed9bffc-3482-4d02-804f-2d46a87d78b1-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:29 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.597s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:29 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 Sep 28 18:12:29 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (7e5f356b-a22f-4744-b2f9-573cb2a0737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75751992-9f6c-4974-a19f-fd0b8ae5e737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75751992-9f6c-4974-a19f-fd0b8ae5e737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1190508901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0989c65-78fb-4e85-ad25-a71585bff51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:29Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25bbe90-e4e6-44ce-a854-7e9dd7d105cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25bbe90-e4e6-44ce-a854-7e9dd7d105cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114fefe0-c3fb-4c69-a4f1-2ca30e9305c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114fefe0-c3fb-4c69-a4f1-2ca30e9305c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0989c65-78fb-4e85-ad25-a71585bff51a', 'volume_name': 'volume-f0989c65-78fb-4e85-ad25-a71585bff51a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee16293-7f73-4a59-9497-465e4249e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee16293-7f73-4a59-9497-465e4249e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37399a4e-fd1d-4651-ad07-66890da388c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:29 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Volume f0989c65-78fb-4e85-ad25-a71585bff51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0989c65-78fb-4e85-ad25-a71585bff51a', 'volume_size': 1} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1190508901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0989c65-78fb-4e85-ad25-a71585bff51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:29Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Creating volume f0989c65-78fb-4e85-ad25-a71585bff51a {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:29 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:29 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a 1073741824 Sep 28 18:12:29 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:29 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" returned: 0 in 0.509s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:29 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66 Sep 28 18:12:29 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:30 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a 1073741824" returned: 0 in 0.663s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=80,cinder:UPDATE=65,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=64,cinder:UPDATE=74,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:30 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a Sep 28 18:12:30 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:30 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" returned: 0 in 0.474s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-22d5ca4a-df2d-4d7c-8204-0004ba8f4c66" released by "_delete_snapshot" :: held 2.253s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" released by "delete_snapshot" :: held 2.295s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Created reservations ['265ce27e-7c5f-490a-a7b5-11b6685c5a2c', 'cc00b0a4-61bb-4266-b4f4-13bf0d3d9342', 'b8891c3f-c32c-4814-9c52-6354be52c779', 'e5906e0c-7440-4d83-af94-bb09417bea3d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Delete snapshot completed successfully. Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-31d44f73-9d51-4c07-84d5-3de0c0f99d92 tempest-SnapshotsActionsTest-833359107 None] Lock "cinder-22d5ca4a-df2d-4d7c-8204-0004ba8f4c66-delete_snapshot" released by "delete_snapshot" :: held 2.542s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:30 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a" returned: 0 in 0.469s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37399a4e-fd1d-4651-ad07-66890da388c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0989c65-78fb-4e85-ad25-a71585bff51a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0907782c-e5e1-4256-a6ad-1be191b39788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:30 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Volume volume-f0989c65-78fb-4e85-ad25-a71585bff51a (f0989c65-78fb-4e85-ad25-a71585bff51a): created successfully Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0907782c-e5e1-4256-a6ad-1be191b39788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (7e5f356b-a22f-4744-b2f9-573cb2a0737b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9641084e-1994-4f94-9052-7c9259789345 tempest-VolumesActionsTest-1537575616 None] Created volume successfully. Sep 28 18:12:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-f0989c65-78fb-4e85-ad25-a71585bff51a-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Lock "cinder-f0989c65-78fb-4e85-ad25-a71585bff51a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-quobyte-f0989c65-78fb-4e85-ad25-a71585bff51a" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-f0989c65-78fb-4e85-ad25-a71585bff51a" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "cinder-a1ce2517-068e-4195-8984-42e6f4ad7ea1-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:31 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf5cf68-e423-4af7-8066-0e6d6117c1cc]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-a1ce2517-068e-4195-8984-42e6f4ad7ea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "cinder-quobyte-a1ce2517-068e-4195-8984-42e6f4ad7ea1" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-quobyte-a1ce2517-068e-4195-8984-42e6f4ad7ea1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Deleting offline snapshot a1ce2517-068e-4195-8984-42e6f4ad7ea1 of volume 0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] snapshot_file for this snap is: volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:32 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a Sep 28 18:12:32 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[0083dcb0-fbda-416f-9800-9d3e48db9d85]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:32 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a" returned: 0 in 0.522s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a Sep 28 18:12:32 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.555s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64e5115-add2-40dd-8ab9-8b8a024a204d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f0989c65-78fb-4e85-ad25-a71585bff51a" returned: 0 in 0.356s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-f0989c65-78fb-4e85-ad25-a71585bff51a" released by "delete_volume" :: held 0.947s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:32 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 Sep 28 18:12:32 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Created reservations ['bf5145b3-7d17-4f3d-8fdc-d55bcbfbfbbf', '3f497306-f3f2-4eb2-9b59-fc4f5887489b', 'ca0c7ade-f5bb-4997-9734-0adb9c2508df', 'b90c81da-6b21-42a8-bccd-f101618ee071'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:33 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:33 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050" returned: 0 in 0.549s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:33 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:33 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.328s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Deleted volume successfully. Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b0cf365-a7f3-4d4e-b016-7f6ff7dd63e4 tempest-VolumesActionsTest-728427353 None] Lock "cinder-f0989c65-78fb-4e85-ad25-a71585bff51a-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:33 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.444s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1 Sep 28 18:12:33 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:34 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050.a1ce2517-068e-4195-8984-42e6f4ad7ea1" returned: 0 in 0.329s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-quobyte-a1ce2517-068e-4195-8984-42e6f4ad7ea1" released by "_delete_snapshot" :: held 2.104s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" released by "delete_snapshot" :: held 2.148s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Created reservations ['9718012b-6672-4f16-9db9-cf8b271efe60', 'a990aeab-a9c4-4380-82e7-f80d2604d289', 'a837ce3d-3823-49bf-a01d-d944705112ab', 'd903cc71-0242-43c4-acd9-b91713cd118e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:34 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Delete snapshot completed successfully. Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-11a39490-50a7-4162-8da6-9d910546edb8 tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-a1ce2517-068e-4195-8984-42e6f4ad7ea1-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (6d86e26d-7436-4049-b232-9fb217803c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85fee29-1252-49ce-a83e-ea4fcfa5a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85fee29-1252-49ce-a83e-ea4fcfa5a615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1110750286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c26916-3f5a-45f6-8f04-11d4511beb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:35Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f03108-cd9f-4f33-93cd-2f4dce8882a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f03108-cd9f-4f33-93cd-2f4dce8882a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1da9d3-e8a5-4e63-89eb-27a64620b2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1da9d3-e8a5-4e63-89eb-27a64620b2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c26916-3f5a-45f6-8f04-11d4511beb52', 'volume_name': 'volume-c0c26916-3f5a-45f6-8f04-11d4511beb52', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ee8382-a7ea-43ec-a00c-a10729e1737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ee8382-a7ea-43ec-a00c-a10729e1737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f668a9d-8c99-4e97-9d00-b431169d0274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:34 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Volume c0c26916-3f5a-45f6-8f04-11d4511beb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c26916-3f5a-45f6-8f04-11d4511beb52', 'volume_size': 1} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1110750286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c26916-3f5a-45f6-8f04-11d4511beb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:35Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Creating volume c0c26916-3f5a-45f6-8f04-11d4511beb52 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:34 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:34 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 1073741824 Sep 28 18:12:34 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "cinder-0d0c8204-b9ec-44f1-8700-77fe43d0f050-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-0d0c8204-b9ec-44f1-8700-77fe43d0f050-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa61729-cd37-41cc-a06e-f954570b553a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:35 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 1073741824" returned: 0 in 0.660s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:35 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 Sep 28 18:12:35 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:35 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 Sep 28 18:12:35 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:35 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52" returned: 0 in 0.360s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f668a9d-8c99-4e97-9d00-b431169d0274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c26916-3f5a-45f6-8f04-11d4511beb52', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f21d40e-6ed9-44cd-9a3b-7707db4639a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Volume volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 (c0c26916-3f5a-45f6-8f04-11d4511beb52): created successfully Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f21d40e-6ed9-44cd-9a3b-7707db4639a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (6d86e26d-7436-4049-b232-9fb217803c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:36 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-95286c76-1cd2-4c19-bea6-e11c7d74b652 tempest-VolumesActionsTest-1537575616 None] Created volume successfully. Sep 28 18:12:36 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050" returned: 0 in 0.594s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:36 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050 Sep 28 18:12:36 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:36 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0d0c8204-b9ec-44f1-8700-77fe43d0f050" returned: 0 in 0.318s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-quobyte-0d0c8204-b9ec-44f1-8700-77fe43d0f050" released by "delete_volume" :: held 1.001s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Created reservations ['9ea842d8-a413-49a8-a149-0b21e3a4190e', '0648dcd2-fb84-4188-9961-7014e4724372', 'fbdf884b-7fce-471e-94c0-a340b7149c8f', 'f528ebca-f63f-491e-9631-11dbe70844d1'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:36 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:36 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:36 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.304s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:36 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:36 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Deleted volume successfully. Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-802d6241-ccce-4a6c-891f-57fffb26ca4e tempest-SnapshotsActionsTest-714478928 None] Lock "cinder-0d0c8204-b9ec-44f1-8700-77fe43d0f050-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-c0c26916-3f5a-45f6-8f04-11d4511beb52-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Lock "cinder-c0c26916-3f5a-45f6-8f04-11d4511beb52-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-quobyte-c0c26916-3f5a-45f6-8f04-11d4511beb52" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-c0c26916-3f5a-45f6-8f04-11d4511beb52" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d00833-a539-4839-a6ea-fd83156e0e67]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:37 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 Sep 28 18:12:37 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:37 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52" returned: 0 in 0.506s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:37 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52 Sep 28 18:12:37 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:38 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0c26916-3f5a-45f6-8f04-11d4511beb52" returned: 0 in 0.324s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-c0c26916-3f5a-45f6-8f04-11d4511beb52" released by "delete_volume" :: held 0.898s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Created reservations ['e3112fda-ec68-4923-968b-d1bfe41a302b', '4611abea-0360-4ad9-9ee7-0e41291d8b3c', 'b8a664a4-98fa-40c4-be7c-a9972930fbc3', '484eae1c-ba30-4a19-a986-0427207bdf9d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:38 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:38 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:38 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:38 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:38 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.482s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Deleted volume successfully. Sep 28 18:12:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6fc044c5-effb-41e7-8e6c-b5a384c19914 tempest-VolumesActionsTest-728427353 None] Lock "cinder-c0c26916-3f5a-45f6-8f04-11d4511beb52-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:39 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.526s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (f44872c8-011e-4e4a-b81b-c55fa710ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729608e5-920a-496a-88c1-bf6d5624a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729608e5-920a-496a-88c1-bf6d5624a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978171202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf5f881-c643-4cba-9466-3b6df2a0114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:39Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9546c8e9-fec1-4cde-9fec-2a47516f0d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9546c8e9-fec1-4cde-9fec-2a47516f0d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c27f988-0e76-40a6-865c-8d8483fae8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c27f988-0e76-40a6-865c-8d8483fae8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf5f881-c643-4cba-9466-3b6df2a0114d', 'volume_name': 'volume-dbf5f881-c643-4cba-9466-3b6df2a0114d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191db2a9-ca88-4bff-b2bb-fe8eed8eee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191db2a9-ca88-4bff-b2bb-fe8eed8eee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d50180-b291-47da-b567-3c6d80ed2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Volume dbf5f881-c643-4cba-9466-3b6df2a0114d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf5f881-c643-4cba-9466-3b6df2a0114d', 'volume_size': 1} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978171202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf5f881-c643-4cba-9466-3b6df2a0114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:39Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Creating volume dbf5f881-c643-4cba-9466-3b6df2a0114d {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:39 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:39 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d 1073741824 Sep 28 18:12:39 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:40 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d 1073741824" returned: 0 in 0.738s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:40 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d Sep 28 18:12:40 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:41 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d" returned: 0 in 0.664s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d50180-b291-47da-b567-3c6d80ed2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf5f881-c643-4cba-9466-3b6df2a0114d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee43c2c-c5f1-43eb-ba38-2cebcc41a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:41 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Volume volume-dbf5f881-c643-4cba-9466-3b6df2a0114d (dbf5f881-c643-4cba-9466-3b6df2a0114d): created successfully Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee43c2c-c5f1-43eb-ba38-2cebcc41a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (f44872c8-011e-4e4a-b81b-c55fa710ff13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a7c759db-90b2-4603-8b01-b519220bd008 tempest-VolumesActionsTest-1537575616 None] Created volume successfully. Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-dbf5f881-c643-4cba-9466-3b6df2a0114d-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Lock "cinder-dbf5f881-c643-4cba-9466-3b6df2a0114d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Acquiring lock "cinder-quobyte-dbf5f881-c643-4cba-9466-3b6df2a0114d" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-dbf5f881-c643-4cba-9466-3b6df2a0114d" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4ef213-e891-44b0-a42f-36313e9299b8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:42 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d Sep 28 18:12:42 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:42 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d" returned: 0 in 0.573s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:42 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d Sep 28 18:12:42 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dbf5f881-c643-4cba-9466-3b6df2a0114d" returned: 0 in 0.495s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Lock "cinder-quobyte-dbf5f881-c643-4cba-9466-3b6df2a0114d" released by "delete_volume" :: held 1.154s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Created reservations ['4b211ae9-6861-4a8a-9aa7-d30989cc5e93', '0fa4021a-4148-49e5-8b8a-f2c0bd993396', '23ea900d-18b4-473d-9031-cc3fcc51fae6', 'c1a3ea40-ef5f-4bae-824b-6d2f1fa3b748'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:43 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:43 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.379s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Deleted volume successfully. Sep 28 18:12:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-27e111a7-d7ae-4279-9eed-ea1e09bad33f tempest-VolumesActionsTest-728427353 None] Lock "cinder-dbf5f881-c643-4cba-9466-3b6df2a0114d-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (d0f7f722-cb43-4de7-9728-8ff6fc4ee1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1576720b-6910-4264-bff8-b94e2048316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1576720b-6910-4264-bff8-b94e2048316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1060682796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e5726b-d84a-4b59-ad87-58d9710c7fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:45Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012ad9da-b878-4312-a409-475756cd74b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012ad9da-b878-4312-a409-475756cd74b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c1789b-1c4e-4af6-ac25-b91bff14b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c1789b-1c4e-4af6-ac25-b91bff14b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e5726b-d84a-4b59-ad87-58d9710c7fe8', 'volume_name': 'volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d09a7b-b7f6-4b19-ab5b-c4fab62593db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d09a7b-b7f6-4b19-ab5b-c4fab62593db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f22cb94-ccac-43c9-b7cd-d82fc5998df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Volume e1e5726b-d84a-4b59-ad87-58d9710c7fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8', 'volume_size': 1} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1060682796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e5726b-d84a-4b59-ad87-58d9710c7fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578809ebc454a2691f2685fdc42f79a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:45Z,use_quota=True,user_id='92f17269fce2462d979abeae988d270f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Creating volume e1e5726b-d84a-4b59-ad87-58d9710c7fe8 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:45 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:45 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 1073741824 Sep 28 18:12:45 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:45 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 1073741824" returned: 0 in 0.706s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:46 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 Sep 28 18:12:46 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:46 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f22cb94-ccac-43c9-b7cd-d82fc5998df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccedd7b0-50e1-4daf-a9e4-d514a2bed903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:46 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Volume volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 (e1e5726b-d84a-4b59-ad87-58d9710c7fe8): created successfully Sep 28 18:12:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccedd7b0-50e1-4daf-a9e4-d514a2bed903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Flow 'volume_create_manager' (d0f7f722-cb43-4de7-9728-8ff6fc4ee1fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:46 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a54dafe7-db77-4b4d-8230-06cbe84c8c67 tempest-VolumesActionsTest-1537575616 None] Created volume successfully. Sep 28 18:12:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Acquiring lock "cinder-6def24f8-79ae-47d4-a028-d3247fc30c60-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "cinder-6def24f8-79ae-47d4-a028-d3247fc30c60-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Acquiring lock "cinder-quobyte-6def24f8-79ae-47d4-a028-d3247fc30c60" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "cinder-quobyte-6def24f8-79ae-47d4-a028-d3247fc30c60" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3168775d-b849-4eeb-a90d-8608494a2d0f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:47 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 Sep 28 18:12:47 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60" returned: 0 in 0.622s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:48 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60 Sep 28 18:12:48 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "cinder-e1e5726b-d84a-4b59-ad87-58d9710c7fe8-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-e1e5726b-d84a-4b59-ad87-58d9710c7fe8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "cinder-quobyte-e1e5726b-d84a-4b59-ad87-58d9710c7fe8" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-quobyte-e1e5726b-d84a-4b59-ad87-58d9710c7fe8" acquired by "delete_volume" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf44b09-298f-4ff9-a9cd-0678dcecff3f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:48 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6def24f8-79ae-47d4-a028-d3247fc30c60" returned: 0 in 0.502s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "cinder-quobyte-6def24f8-79ae-47d4-a028-d3247fc30c60" released by "delete_volume" :: held 1.220s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Created reservations ['0c011547-15e9-48c3-b869-776751940db3', '4426d537-206b-41fd-b43a-804958f0a53a', 'efa0f001-58e0-4720-8dab-a23b601303e6', '4426b631-73cb-437a-91af-22d0f1891e89'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:48 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 Sep 28 18:12:48 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:49 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8" returned: 0 in 0.581s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.338s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:49 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8 Sep 28 18:12:49 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Deleted volume successfully. Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1cc83db9-669f-4c8a-b6af-c153073d8483 tempest-AttachVolumeShelveTestJSON-577828968 None] Lock "cinder-6def24f8-79ae-47d4-a028-d3247fc30c60-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:49 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e1e5726b-d84a-4b59-ad87-58d9710c7fe8" returned: 0 in 0.349s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-quobyte-e1e5726b-d84a-4b59-ad87-58d9710c7fe8" released by "delete_volume" :: held 1.033s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Created reservations ['a71fd7f3-76ce-4f8c-9960-7f5a2b49dd69', '7d790555-6d04-40fd-85c4-8c27c002cd15', 'f4b3572e-fba2-436e-8bf7-c39ebb025192', '661ccc67-acd8-48ab-9ed8-86b36d6f44c3'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:49 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Flow 'volume_create_manager' (c17eb559-4c99-4df5-863a-1016e7ad7c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0978e0c4-beec-4205-8c68-47c1a7959eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0978e0c4-beec-4205-8c68-47c1a7959eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-42416600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8f408a-f7da-4b0e-9827-9a0f0ba40db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b4faf013604e1a9f9a3a45be2f08c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:50Z,use_quota=True,user_id='105cb7e1b6a74ad9b369fa1827d5f365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f38496-13da-40ae-baa4-a29adfc8a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f38496-13da-40ae-baa4-a29adfc8a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80054f7a-f7f6-4f67-a115-b9940b3b303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80054f7a-f7f6-4f67-a115-b9940b3b303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8f408a-f7da-4b0e-9827-9a0f0ba40db2', 'volume_name': 'volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a74258-628c-4beb-84b9-ebbce9230129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a74258-628c-4beb-84b9-ebbce9230129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9221e8-458b-4402-bdb0-35c6b7e34542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:50 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Volume 3e8f408a-f7da-4b0e-9827-9a0f0ba40db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2', 'volume_size': 1} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-42416600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8f408a-f7da-4b0e-9827-9a0f0ba40db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b4faf013604e1a9f9a3a45be2f08c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:50Z,use_quota=True,user_id='105cb7e1b6a74ad9b369fa1827d5f365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Creating volume 3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:50 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:50 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.364s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:50 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Deleted volume successfully. Sep 28 18:12:50 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 1073741824 Sep 28 18:12:50 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-21916937-4e38-49da-9165-1fbec7207967 tempest-VolumesActionsTest-1537575616 None] Lock "cinder-e1e5726b-d84a-4b59-ad87-58d9710c7fe8-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:50 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 1073741824" returned: 0 in 0.612s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:50 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 Sep 28 18:12:50 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:51 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2" returned: 0 in 0.357s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9221e8-458b-4402-bdb0-35c6b7e34542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da3e50f-2098-4c11-ae52-266f40e85d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:51 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Volume volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 (3e8f408a-f7da-4b0e-9827-9a0f0ba40db2): created successfully Sep 28 18:12:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da3e50f-2098-4c11-ae52-266f40e85d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Flow 'volume_create_manager' (c17eb559-4c99-4df5-863a-1016e7ad7c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a499eb79-f21f-411c-a983-7076ff096e05 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Created volume successfully. Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Acquiring lock "cinder-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "cinder-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Acquiring lock "cinder-quobyte-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "cinder-quobyte-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c9fbbd-0090-4a0c-973f-9fff43094317]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:52 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 Sep 28 18:12:52 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:52 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2" returned: 0 in 0.439s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:53 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2 Sep 28 18:12:53 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:53 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2" returned: 0 in 0.486s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "cinder-quobyte-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2" released by "delete_volume" :: held 0.996s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Created reservations ['36449f40-b3df-431f-9e59-6e109a14ae8e', '5adf7c71-fd41-4104-8eff-9dd71552c89d', '1c1bbf2f-51e2-4476-88d9-f9ee12388f79', '8f166458-2e12-4d09-8f94-e25d26c120bf'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:53 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:12:53 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:53 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:53 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Deleted volume successfully. Sep 28 18:12:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e62e4bb8-635f-49b2-8828-ea3e33830548 tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "cinder-3e8f408a-f7da-4b0e-9827-9a0f0ba40db2-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Flow 'volume_create_manager' (ef22d7fb-1411-4995-83e8-04411f3b18af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfef8cb-46ae-450e-b8c3-5e78726ceca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfef8cb-46ae-450e-b8c3-5e78726ceca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-287734769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ebfbea-1088-4211-99c0-7b2151e1f1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b4faf013604e1a9f9a3a45be2f08c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:55Z,use_quota=True,user_id='105cb7e1b6a74ad9b369fa1827d5f365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e33c57-62f4-4db9-be72-c3f9654d1460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e33c57-62f4-4db9-be72-c3f9654d1460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544b7f60-f29e-4a73-88e2-f30d570859c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544b7f60-f29e-4a73-88e2-f30d570859c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ebfbea-1088-4211-99c0-7b2151e1f1b0', 'volume_name': 'volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5018a9e9-3173-4835-821f-ab307079c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5018a9e9-3173-4835-821f-ab307079c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f570b0-0f13-4a15-be4e-b5b2ca3874e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Volume d3ebfbea-1088-4211-99c0-7b2151e1f1b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0', 'volume_size': 1} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-287734769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ebfbea-1088-4211-99c0-7b2151e1f1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b4faf013604e1a9f9a3a45be2f08c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:55Z,use_quota=True,user_id='105cb7e1b6a74ad9b369fa1827d5f365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Creating volume d3ebfbea-1088-4211-99c0-7b2151e1f1b0 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:55 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:12:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:55 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 1073741824 Sep 28 18:12:55 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:56 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 1073741824" returned: 0 in 0.602s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:56 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 Sep 28 18:12:56 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:56 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0" returned: 0 in 0.301s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f570b0-0f13-4a15-be4e-b5b2ca3874e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38256d6-bac4-4fe6-a98c-76b134b319c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:56 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Volume volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 (d3ebfbea-1088-4211-99c0-7b2151e1f1b0): created successfully Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38256d6-bac4-4fe6-a98c-76b134b319c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Flow 'volume_create_manager' (ef22d7fb-1411-4995-83e8-04411f3b18af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b2bea0e6-7434-42a9-ba79-7231e1c110cd tempest-VolumeQuotasAdminTestJSON-1155488212 None] Created volume successfully. Sep 28 18:12:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f3b625ef-1ba3-4af2-bb25-393641e47b7f tempest-VolumeQuotasAdminTestJSON-761977651 None] Transfer volume completed successfully. Sep 28 18:12:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Acquiring lock "cinder-d3ebfbea-1088-4211-99c0-7b2151e1f1b0-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Lock "cinder-d3ebfbea-1088-4211-99c0-7b2151e1f1b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Acquiring lock "cinder-quobyte-d3ebfbea-1088-4211-99c0-7b2151e1f1b0" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Lock "cinder-quobyte-d3ebfbea-1088-4211-99c0-7b2151e1f1b0" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:59 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cadbd0b-94bc-4a31-b028-8f6649dffbfb]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:59 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 Sep 28 18:12:59 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:00 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0" returned: 0 in 0.599s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0 Sep 28 18:13:00 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:00 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d3ebfbea-1088-4211-99c0-7b2151e1f1b0" returned: 0 in 0.444s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Lock "cinder-quobyte-d3ebfbea-1088-4211-99c0-7b2151e1f1b0" released by "delete_volume" :: held 1.129s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Created reservations ['e9ff99e8-d173-450d-99fc-c541eb20526e', 'ea8d7422-772e-4801-acc9-3d019b9da5a2', '9ed8f063-08e8-4473-b9fa-d2afdcdbf8f1', '7a0310e1-2e5f-44e9-b9aa-8d3080f9a539'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:13:00 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:01 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.363s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:01 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Deleted volume successfully. Sep 28 18:13:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c9dd307f-613e-481c-b5c2-4cb53ddea508 tempest-VolumeQuotasAdminTestJSON-185736947 None] Lock "cinder-d3ebfbea-1088-4211-99c0-7b2151e1f1b0-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:10 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=62,cinder:INSERT=23,cinder:UPDATE=90,cinder:DELETE=9 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:11 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=60,cinder:INSERT=23,cinder:UPDATE=94,cinder:DELETE=5 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Flow 'volume_create_manager' (c09a6458-7719-412a-889d-30b8514723ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c902aeac-1c1b-462d-8450-74c3a9522c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c902aeac-1c1b-462d-8450-74c3a9522c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-169558293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e56d49-f022-415a-8912-3cdbcc5e7430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005dd850be6445097bfdbb58539f076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:20Z,use_quota=True,user_id='c62a708f6dcc4c81a5779fb89796fe15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c72ee-c33b-4063-b320-a382810710ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c72ee-c33b-4063-b320-a382810710ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac02972-af50-4485-afad-1fa2e03e9a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac02972-af50-4485-afad-1fa2e03e9a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e56d49-f022-415a-8912-3cdbcc5e7430', 'volume_name': 'volume-13e56d49-f022-415a-8912-3cdbcc5e7430', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baa4021-3f63-4b84-bff6-02ac4569d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baa4021-3f63-4b84-bff6-02ac4569d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ae57ce-47a7-4a42-9fef-3410f856efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:20 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Volume 13e56d49-f022-415a-8912-3cdbcc5e7430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e56d49-f022-415a-8912-3cdbcc5e7430', 'volume_size': 1} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-169558293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e56d49-f022-415a-8912-3cdbcc5e7430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4005dd850be6445097bfdbb58539f076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:20Z,use_quota=True,user_id='c62a708f6dcc4c81a5779fb89796fe15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Creating volume 13e56d49-f022-415a-8912-3cdbcc5e7430 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:20 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:13:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:20 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 1073741824 Sep 28 18:13:20 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 1073741824" returned: 0 in 0.761s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:21 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 Sep 28 18:13:21 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430" returned: 0 in 0.397s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ae57ce-47a7-4a42-9fef-3410f856efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e56d49-f022-415a-8912-3cdbcc5e7430', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ca64a3-1c96-4e56-9ffe-a4e3883ed05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:21 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Volume volume-13e56d49-f022-415a-8912-3cdbcc5e7430 (13e56d49-f022-415a-8912-3cdbcc5e7430): created successfully Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ca64a3-1c96-4e56-9ffe-a4e3883ed05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Flow 'volume_create_manager' (c09a6458-7719-412a-889d-30b8514723ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4f4ae191-4673-4f00-ba04-ddfa1ea57630 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Created volume successfully. Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Acquiring lock "cinder-13e56d49-f022-415a-8912-3cdbcc5e7430-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "cinder-13e56d49-f022-415a-8912-3cdbcc5e7430-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Acquiring lock "cinder-quobyte-13e56d49-f022-415a-8912-3cdbcc5e7430" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "cinder-quobyte-13e56d49-f022-415a-8912-3cdbcc5e7430" acquired by "delete_volume" :: waited 0.051s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d538323c-1e43-4602-8357-d9e00f739571]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:25 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 Sep 28 18:13:25 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:25 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430" returned: 0 in 0.657s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:25 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430 Sep 28 18:13:25 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:26 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-13e56d49-f022-415a-8912-3cdbcc5e7430" returned: 0 in 0.709s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "cinder-quobyte-13e56d49-f022-415a-8912-3cdbcc5e7430" released by "delete_volume" :: held 1.487s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:26 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Created reservations ['1d9c054c-207b-4e20-9250-795eeef8d1a7', 'a69e1b7c-bbc3-474c-ba5a-9a1d0209d3d6', '90d2bece-44a4-47a1-a6a6-e943418106c8', '2c4aa02d-85be-4f37-98ee-b6388d4ac56c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:27 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:13:27 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:27 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.779s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:27 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Deleted volume successfully. Sep 28 18:13:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ed2c937-ce9e-480d-a191-93be2faa9f53 tempest-VolumeQuotasNegativeTestJSON-1284601113 None] Lock "cinder-13e56d49-f022-415a-8912-3cdbcc5e7430-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:37 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=8,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:38 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:13:38 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:39 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.748s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:13:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Flow 'volume_create_manager' (ce23e6db-56f2-47b8-87cb-08da442cbb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04117abb-479b-4f0a-92a4-17a7089fdc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04117abb-479b-4f0a-92a4-17a7089fdc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1960503959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34109bad-723f-4f44-bbc7-82d43f70dc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84513c83d9a943fbbd29dca7f7d7a1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:43Z,use_quota=True,user_id='9034d145cc9745b5bb2c30ad03f2c5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8342344a-101d-4481-af51-4bfe115ef56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8342344a-101d-4481-af51-4bfe115ef56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54ea1cb-9fff-4e6e-ab56-8faf00b06549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54ea1cb-9fff-4e6e-ab56-8faf00b06549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34109bad-723f-4f44-bbc7-82d43f70dc79', 'volume_name': 'volume-34109bad-723f-4f44-bbc7-82d43f70dc79', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ce76f-bffe-4846-83ff-bd60b07062b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ce76f-bffe-4846-83ff-bd60b07062b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2277b6be-03fd-486c-a247-a0cfbd738ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Volume 34109bad-723f-4f44-bbc7-82d43f70dc79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34109bad-723f-4f44-bbc7-82d43f70dc79', 'volume_size': 1} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1960503959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34109bad-723f-4f44-bbc7-82d43f70dc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84513c83d9a943fbbd29dca7f7d7a1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:43Z,use_quota=True,user_id='9034d145cc9745b5bb2c30ad03f2c5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Creating volume 34109bad-723f-4f44-bbc7-82d43f70dc79 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:43 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:13:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:44 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 1073741824 Sep 28 18:13:44 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:45 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 1073741824" returned: 0 in 1.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:45 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 Sep 28 18:13:45 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Flow 'volume_create_manager' (505bb69a-f506-4222-90f0-c5adc8ff60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c481c3-2aee-4de6-b152-a8748d26ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c481c3-2aee-4de6-b152-a8748d26ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1051658289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511d81d7-ca26-41ac-85dc-e023740d3840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b633b26b864e0e8dfd317273f82466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:46Z,use_quota=True,user_id='fb30f3b33d704efd8d0fbcec2f207be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821d2b7-2dfa-463f-95bc-6b0ad38c22d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5821d2b7-2dfa-463f-95bc-6b0ad38c22d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55aaf520-f84a-4cb7-87bf-82b2fdeffb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55aaf520-f84a-4cb7-87bf-82b2fdeffb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511d81d7-ca26-41ac-85dc-e023740d3840', 'volume_name': 'volume-511d81d7-ca26-41ac-85dc-e023740d3840', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d71a90-0ba0-43f4-b437-7e8064576d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d71a90-0ba0-43f4-b437-7e8064576d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e29a40-ee73-4766-9af0-4dda4f0d0147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Volume 511d81d7-ca26-41ac-85dc-e023740d3840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511d81d7-ca26-41ac-85dc-e023740d3840', 'volume_size': 1} Sep 28 18:13:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:46 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79" returned: 0 in 0.664s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] <== create_volume: return (2263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1051658289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511d81d7-ca26-41ac-85dc-e023740d3840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b633b26b864e0e8dfd317273f82466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:46Z,use_quota=True,user_id='fb30f3b33d704efd8d0fbcec2f207be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Creating volume 511d81d7-ca26-41ac-85dc-e023740d3840 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:46 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:46 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 1073741824 Sep 28 18:13:46 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2277b6be-03fd-486c-a247-a0cfbd738ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34109bad-723f-4f44-bbc7-82d43f70dc79', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ec48d0-4f09-4e6e-a241-46c1cdc7e64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:46 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Volume volume-34109bad-723f-4f44-bbc7-82d43f70dc79 (34109bad-723f-4f44-bbc7-82d43f70dc79): created successfully Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ec48d0-4f09-4e6e-a241-46c1cdc7e64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Flow 'volume_create_manager' (ce23e6db-56f2-47b8-87cb-08da442cbb15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:46 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-869f49e6-151e-4fd2-b826-5890813ba0e0 tempest-ServerRescueNegativeTestJSON-1859109333 None] Created volume successfully. Sep 28 18:13:47 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 1073741824" returned: 0 in 0.823s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:47 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 Sep 28 18:13:47 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Flow 'volume_create_manager' (689bd82a-7e9e-4b07-aa4b-fd6306550a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529c5398-6084-4850-878d-7f4bc8aca0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529c5398-6084-4850-878d-7f4bc8aca0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1929153510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a575ccbcbf504d2687d8b1e85c428196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:47Z,use_quota=True,user_id='d96b3e45cb224d40b1ada9eb1bb1a5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1617655c-4c2f-477b-b21f-6b98b9f4a135),volume_type_id=1617655c-4c2f-477b-b21f-6b98b9f4a135)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9baf510c-a259-42b6-880a-754047435c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9baf510c-a259-42b6-880a-754047435c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ad2954-e56c-4163-80b4-3594399d4cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ad2954-e56c-4163-80b4-3594399d4cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9', 'volume_name': 'volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17efc786-a85e-46a1-93f8-8a60884c6f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17efc786-a85e-46a1-93f8-8a60884c6f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98e2dd7-259d-4873-a1e9-f4b97cb53540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Volume 5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9', 'volume_size': 1} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:47 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840" returned: 0 in 0.589s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.180s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1929153510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a575ccbcbf504d2687d8b1e85c428196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:47Z,use_quota=True,user_id='d96b3e45cb224d40b1ada9eb1bb1a5ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1617655c-4c2f-477b-b21f-6b98b9f4a135),volume_type_id=1617655c-4c2f-477b-b21f-6b98b9f4a135)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Creating volume 5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:47 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:47 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 1073741824 Sep 28 18:13:47 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e29a40-ee73-4766-9af0-4dda4f0d0147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511d81d7-ca26-41ac-85dc-e023740d3840', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfccaac-3e5c-488b-82d4-1a7b798fb481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Volume volume-511d81d7-ca26-41ac-85dc-e023740d3840 (511d81d7-ca26-41ac-85dc-e023740d3840): created successfully Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfccaac-3e5c-488b-82d4-1a7b798fb481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Flow 'volume_create_manager' (505bb69a-f506-4222-90f0-c5adc8ff60cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:47 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a58dbff0-4721-4f69-97cc-083dd80381e0 tempest-VolumesMetadataTest-1715841053 None] Created volume successfully. Sep 28 18:13:48 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 1073741824" returned: 0 in 0.680s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:48 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 Sep 28 18:13:48 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9" returned: 0 in 1.029s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98e2dd7-259d-4873-a1e9-f4b97cb53540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2444d481-ff4e-4ac8-b2c8-ef4a6580961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Volume volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 (5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9): created successfully Sep 28 18:13:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2444d481-ff4e-4ac8-b2c8-ef4a6580961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Flow 'volume_create_manager' (689bd82a-7e9e-4b07-aa4b-fd6306550a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-59a83c04-0bcc-46c4-a199-10952bbb478c tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Created volume successfully. Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Acquiring lock "cinder-511d81d7-ca26-41ac-85dc-e023740d3840-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Lock "cinder-511d81d7-ca26-41ac-85dc-e023740d3840-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Acquiring lock "cinder-quobyte-511d81d7-ca26-41ac-85dc-e023740d3840" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:52 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:13:52 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Lock "cinder-quobyte-511d81d7-ca26-41ac-85dc-e023740d3840" acquired by "delete_volume" :: waited 0.044s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[151dc820-d50e-4ef4-827b-a5c437e525ae]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:52 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 Sep 28 18:13:52 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:52 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.601s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:52 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4378562f-2f91-4245-83d9-b9d893d007ae tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Retype volume completed successfully. Sep 28 18:13:53 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840" returned: 0 in 0.953s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:53 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840 Sep 28 18:13:53 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Acquiring lock "cinder-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "cinder-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:53 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-511d81d7-ca26-41ac-85dc-e023740d3840" returned: 0 in 0.813s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Lock "cinder-quobyte-511d81d7-ca26-41ac-85dc-e023740d3840" released by "delete_volume" :: held 1.909s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Acquiring lock "cinder-quobyte-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "cinder-quobyte-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9" acquired by "delete_volume" :: waited 0.041s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ff4a5-4bd0-4d5f-a072-9263e708642b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Created reservations ['88c1eaae-7aba-4df9-a239-7112dc263ffe', '1f40887f-e1ea-4687-ac46-34d04f9be98a', 'ba940d42-b439-48e4-8557-665550cc6fb5', '4e57eaa3-068a-4fde-b336-31452a5dfbb4'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:54 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 Sep 28 18:13:54 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:54 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:13:54 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:55 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:55 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.992s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:55 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9" returned: 0 in 1.398s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Deleted volume successfully. Sep 28 18:13:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:55 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9 Sep 28 18:13:55 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b43fff91-3f3f-48d1-a2b1-6b2856336f4b tempest-VolumesMetadataTest-1715841053 None] Lock "cinder-511d81d7-ca26-41ac-85dc-e023740d3840-delete_volume" released by "delete_volume" :: held 3.874s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:56 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9" returned: 0 in 0.904s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "cinder-quobyte-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9" released by "delete_volume" :: held 2.456s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:56 devstack cinder-volume[86981]: WARNING cinder.quota [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:13:56 devstack cinder-volume[86981]: WARNING cinder.quota [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Created reservations ['08e7633a-143c-4033-84fa-06465b79c5ee', 'b81f5745-8f2a-43e3-b710-125e9182eeab', 'b1b45219-d74f-492a-9957-45c14e3405a5', 'a39fa24e-8973-4b18-a8ae-8a7e5d0d004d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:57 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:13:57 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:57 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 1.036s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:57 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Deleted volume successfully. Sep 28 18:13:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bff7d693-dd8a-4257-9e26-57403f0dd1d6 tempest-VolumeRetypeWithoutMigrationTest-1757437767 None] Lock "cinder-5b3a6b4c-9ad9-4817-a0b3-c1c9179b68c9-delete_volume" released by "delete_volume" :: held 4.253s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:06 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=35,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:08 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=32,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Acquiring lock "cinder-34109bad-723f-4f44-bbc7-82d43f70dc79-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "cinder-34109bad-723f-4f44-bbc7-82d43f70dc79-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Acquiring lock "cinder-quobyte-34109bad-723f-4f44-bbc7-82d43f70dc79" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "cinder-quobyte-34109bad-723f-4f44-bbc7-82d43f70dc79" acquired by "delete_volume" :: waited 0.045s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a6038-8ef1-4f98-9c85-dd0c828b5387]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Flow 'volume_create_manager' (ebc2e838-4c2a-46bb-a54f-224bf5f35dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be5e86c-9e33-4f02-9864-a73073dc7de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be5e86c-9e33-4f02-9864-a73073dc7de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1167943689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8192d2b9-4787-4c8d-8169-864bca810791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b67e4df9a64e758188619d3b32904d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:09Z,use_quota=True,user_id='62c5d25427c64efa8f15b27101ab10b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d838da54-ec71-4073-94b5-b5770e18a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d838da54-ec71-4073-94b5-b5770e18a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9360840c-a53c-4d49-b4fc-865a6a230d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9360840c-a53c-4d49-b4fc-865a6a230d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8192d2b9-4787-4c8d-8169-864bca810791', 'volume_name': 'volume-8192d2b9-4787-4c8d-8169-864bca810791', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d29072-5ab8-4b52-a9ab-ccb5b4e90af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d29072-5ab8-4b52-a9ab-ccb5b4e90af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2208e9b0-5123-4d0f-abda-556b0736c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Volume 8192d2b9-4787-4c8d-8169-864bca810791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8192d2b9-4787-4c8d-8169-864bca810791', 'volume_size': 1} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:09 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1167943689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8192d2b9-4787-4c8d-8169-864bca810791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b67e4df9a64e758188619d3b32904d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:09Z,use_quota=True,user_id='62c5d25427c64efa8f15b27101ab10b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Creating volume 8192d2b9-4787-4c8d-8169-864bca810791 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:09 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:09 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:14:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:09 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 1073741824 Sep 28 18:14:09 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:10 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79" returned: 0 in 0.788s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:10 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79 Sep 28 18:14:10 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:10 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 1073741824" returned: 0 in 1.003s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:10 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-34109bad-723f-4f44-bbc7-82d43f70dc79" returned: 0 in 0.624s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "cinder-quobyte-34109bad-723f-4f44-bbc7-82d43f70dc79" released by "delete_volume" :: held 1.580s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:10 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 Sep 28 18:14:10 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Created reservations ['5a743a04-24d2-4aa3-8b79-712b92647e34', '322df97a-b43d-4516-87a8-7fc28efbbc0a', '3b3b1e5d-7317-426f-ad30-10a37f4a6386', '16d85b0b-8c44-425e-a11e-00d2ae402736'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:11 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:14:11 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:11 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791" returned: 0 in 0.749s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2208e9b0-5123-4d0f-abda-556b0736c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8192d2b9-4787-4c8d-8169-864bca810791', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d373dcdf-a347-4724-99ff-def2b5bc53ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:11 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.542s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Volume volume-8192d2b9-4787-4c8d-8169-864bca810791 (8192d2b9-4787-4c8d-8169-864bca810791): created successfully Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d373dcdf-a347-4724-99ff-def2b5bc53ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Flow 'volume_create_manager' (ebc2e838-4c2a-46bb-a54f-224bf5f35dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Deleted volume successfully. Sep 28 18:14:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e5eb0e6b-bcbc-4891-b941-cb24bde6e4e4 tempest-VolumesTransfersV355Test-888298390 None] Created volume successfully. Sep 28 18:14:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-43b61a29-0ad3-46fc-a965-0a6548927c95 tempest-ServerRescueNegativeTestJSON-1859109333 None] Lock "cinder-34109bad-723f-4f44-bbc7-82d43f70dc79-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fdad8d37-e06c-4b4a-be50-cdee94de6cf6 tempest-VolumesTransfersV355Test-500567308 None] Transfer volume completed successfully. Sep 28 18:14:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Acquiring lock "cinder-8192d2b9-4787-4c8d-8169-864bca810791-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-8192d2b9-4787-4c8d-8169-864bca810791-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Acquiring lock "cinder-quobyte-8192d2b9-4787-4c8d-8169-864bca810791" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-quobyte-8192d2b9-4787-4c8d-8169-864bca810791" acquired by "delete_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[261daf7a-2177-4cf9-b99e-8ed19a4f39bd]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 Sep 28 18:14:16 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:17 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791" returned: 0 in 0.783s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:17 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791 Sep 28 18:14:17 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:17 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8192d2b9-4787-4c8d-8169-864bca810791" returned: 0 in 0.491s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-quobyte-8192d2b9-4787-4c8d-8169-864bca810791" released by "delete_volume" :: held 1.376s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Created reservations ['3b2d36ba-50e9-45d6-bc06-10ffc4cecefb', 'a2bf91e8-86cc-47ad-b423-91462b82ec6f', '17aca199-1e59-43ae-815b-f3e627e63e5e', 'f3a6d783-8615-44d0-8f74-cecd7ec9224d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:18 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:14:18 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:18 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.504s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Deleted volume successfully. Sep 28 18:14:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-579c50e5-4e80-4374-bedb-9bd909821bef tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-8192d2b9-4787-4c8d-8169-864bca810791-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Flow 'volume_create_manager' (3734ee94-632e-4b5e-9d91-0f0c3be3a13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8212d8-7f3b-406b-b76f-0d1e703b7230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8212d8-7f3b-406b-b76f-0d1e703b7230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-181584175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846a728-4c74-4276-882c-eea1e4af513d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b67e4df9a64e758188619d3b32904d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:20Z,use_quota=True,user_id='62c5d25427c64efa8f15b27101ab10b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e786dc-0b78-4295-bc76-249dc2c658ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e786dc-0b78-4295-bc76-249dc2c658ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09985ee5-16c8-4a65-83a1-1f1c91e1facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09985ee5-16c8-4a65-83a1-1f1c91e1facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c846a728-4c74-4276-882c-eea1e4af513d', 'volume_name': 'volume-c846a728-4c74-4276-882c-eea1e4af513d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16846e2a-7a5d-4a71-a978-34bcfbadbc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16846e2a-7a5d-4a71-a978-34bcfbadbc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd3382d-ab9a-48d3-82df-78e6e3d641f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:20 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Volume c846a728-4c74-4276-882c-eea1e4af513d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c846a728-4c74-4276-882c-eea1e4af513d', 'volume_size': 1} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-181584175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846a728-4c74-4276-882c-eea1e4af513d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b67e4df9a64e758188619d3b32904d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:20Z,use_quota=True,user_id='62c5d25427c64efa8f15b27101ab10b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Creating volume c846a728-4c74-4276-882c-eea1e4af513d {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:20 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:20 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d 1073741824 Sep 28 18:14:20 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:20 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d 1073741824" returned: 0 in 0.840s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:20 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d Sep 28 18:14:20 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:21 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d" returned: 0 in 0.331s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd3382d-ab9a-48d3-82df-78e6e3d641f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c846a728-4c74-4276-882c-eea1e4af513d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0ca08c-1619-44c2-8b29-e69dc7c030a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:21 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Volume volume-c846a728-4c74-4276-882c-eea1e4af513d (c846a728-4c74-4276-882c-eea1e4af513d): created successfully Sep 28 18:14:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0ca08c-1619-44c2-8b29-e69dc7c030a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Flow 'volume_create_manager' (3734ee94-632e-4b5e-9d91-0f0c3be3a13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-df54e336-e600-4368-ad95-4089af3ff9bd tempest-VolumesTransfersV355Test-888298390 None] Created volume successfully. Sep 28 18:14:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Acquiring lock "cinder-c846a728-4c74-4276-882c-eea1e4af513d-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-c846a728-4c74-4276-882c-eea1e4af513d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Acquiring lock "cinder-quobyte-c846a728-4c74-4276-882c-eea1e4af513d" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-quobyte-c846a728-4c74-4276-882c-eea1e4af513d" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:22 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[169a0688-ac30-4cd4-a89b-d63341b53d91]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:22 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d Sep 28 18:14:22 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:23 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d" returned: 0 in 0.588s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:23 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d Sep 28 18:14:23 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Flow 'volume_create_manager' (c248be25-7421-485b-929e-f10062e5693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732b9ee5-8d2e-4426-8613-7ba91303ae0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732b9ee5-8d2e-4426-8613-7ba91303ae0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-113853668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60eedfc-7827-4822-ab4a-74cb59d0d827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba0c359dc37430b9e1de0481c9c4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:23Z,use_quota=True,user_id='49765d1a31894716bdddf9e564b65bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:23 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddb4bdc-5445-40be-a9da-7a526ec5e7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddb4bdc-5445-40be-a9da-7a526ec5e7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e563751-59ae-4046-b0b0-db979403be8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e563751-59ae-4046-b0b0-db979403be8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60eedfc-7827-4822-ab4a-74cb59d0d827', 'volume_name': 'volume-d60eedfc-7827-4822-ab4a-74cb59d0d827', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62c7a17-00c9-4957-ba09-0fa5f268ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62c7a17-00c9-4957-ba09-0fa5f268ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eed70e9-8065-4033-a0d8-938c608610b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:23 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Volume d60eedfc-7827-4822-ab4a-74cb59d0d827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60eedfc-7827-4822-ab4a-74cb59d0d827', 'volume_size': 1} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-113853668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60eedfc-7827-4822-ab4a-74cb59d0d827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba0c359dc37430b9e1de0481c9c4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:23Z,use_quota=True,user_id='49765d1a31894716bdddf9e564b65bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Creating volume d60eedfc-7827-4822-ab4a-74cb59d0d827 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:23 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c846a728-4c74-4276-882c-eea1e4af513d" returned: 0 in 0.514s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:23 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 1073741824 Sep 28 18:14:23 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-quobyte-c846a728-4c74-4276-882c-eea1e4af513d" released by "delete_volume" :: held 1.173s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Created reservations ['5e43f3ba-f354-4615-a42c-d4b7db52190c', '9427f6c5-438b-4732-847e-1f239cea58e0', '15a80df3-41f2-41a5-97a0-382897589897', '2dac4ae3-6851-4c86-b346-ffb5146900f8'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:23 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:14:23 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:24 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.524s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:24 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:24 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 1073741824" returned: 0 in 0.882s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:24 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Deleted volume successfully. Sep 28 18:14:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0c8f254-a200-4f0a-9ce6-bcdbd58b42f6 tempest-VolumesTransfersV355Test-1284815620 None] Lock "cinder-c846a728-4c74-4276-882c-eea1e4af513d-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:24 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 Sep 28 18:14:24 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:25 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827" returned: 0 in 0.499s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eed70e9-8065-4033-a0d8-938c608610b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60eedfc-7827-4822-ab4a-74cb59d0d827', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93180bcd-c596-4fb8-a6bc-08b8acc20857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:25 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Volume volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 (d60eedfc-7827-4822-ab4a-74cb59d0d827): created successfully Sep 28 18:14:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93180bcd-c596-4fb8-a6bc-08b8acc20857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Flow 'volume_create_manager' (c248be25-7421-485b-929e-f10062e5693d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a24ec3fa-6229-4db2-95b7-0f04ff8b5458 tempest-AttachVolumeTestJSON-115702562 None] Created volume successfully. Sep 28 18:14:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8913b723-6717-4b0a-a81e-799d9c37360c req-d9c0c86b-01e0-4ff4-8355-7a3f888f8ea8 tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8913b723-6717-4b0a-a81e-799d9c37360c req-d9c0c86b-01e0-4ff4-8355-7a3f888f8ea8 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8913b723-6717-4b0a-a81e-799d9c37360c req-d9c0c86b-01e0-4ff4-8355-7a3f888f8ea8 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-8913b723-6717-4b0a-a81e-799d9c37360c req-d9c0c86b-01e0-4ff4-8355-7a3f888f8ea8 tempest-AttachVolumeTestJSON-115702562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-d60eedfc-7827-4822-ab4a-74cb59d0d827', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdeb0eb0-77c5-4f79-91ce-b35b0a42deac', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:14:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-8913b723-6717-4b0a-a81e-799d9c37360c req-d9c0c86b-01e0-4ff4-8355-7a3f888f8ea8 tempest-AttachVolumeTestJSON-115702562 None] attachment_update completed successfully. Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Flow 'volume_create_manager' (2c0917a6-8d27-41c9-8b99-c041d01ceb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a70d84-3342-4c39-a7ed-667b1a6f60d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a70d84-3342-4c39-a7ed-667b1a6f60d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1134729364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b80a600a9ef4ded9fb8225f5b38d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:34Z,use_quota=True,user_id='06ab898eee5b494dae9f08440fcb0312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a9baaf-4271-49e2-afc9-dbcbd3d9d308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a9baaf-4271-49e2-afc9-dbcbd3d9d308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d9a190-8c0f-4ef1-b076-f504c0cffe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:33 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:14:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d9a190-8c0f-4ef1-b076-f504c0cffe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e', 'volume_name': 'volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dd5e23-afb8-49b2-a790-e9aec64b2543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dd5e23-afb8-49b2-a790-e9aec64b2543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c2bc5d-bfaf-446a-a251-0845ab8e29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:34 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Volume b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:14:34 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Trying to clone b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:14:35 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:14:35 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:14:35 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1356b4cf-8c42-438c-835d-3388d705010e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:35 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD Sep 28 18:14:35 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:36 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 is fetched for user 06ab898eee5b494dae9f08440fcb0312. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed36e4e1-4ada-4d1b-a564-1ad2c60cccd6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:36 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD Sep 28 18:14:36 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:36 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1134729364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b80a600a9ef4ded9fb8225f5b38d810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:34Z,use_quota=True,user_id='06ab898eee5b494dae9f08440fcb0312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Creating volume b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:36 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:14:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:37 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e 1073741824 Sep 28 18:14:37 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:37 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e 1073741824" returned: 0 in 0.804s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:37 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e Sep 28 18:14:37 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:38 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e" returned: 0 in 0.438s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Attempting download of 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db4e339-e4e0-4c9c-93d6-3425bb0c1361]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_jl1irs09 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_jl1irs09 Sep 28 18:14:38 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:14:38 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_jl1irs09" returned: 0 in 0.543s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_jl1irs09 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_jl1irs09 Sep 28 18:14:39 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.579s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:14:39 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_jl1irs09" returned: 1 in 0.622s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_jl1irs09' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe65f78-2993-4c12-88ab-3809964a7bd3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD Sep 28 18:14:39 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] 052187e4-f9b0-4ab2-bf54-351fdb1df836 was qcow2, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:14:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:40 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e Sep 28 18:14:40 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:43 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e" returned: 0 in 3.492s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:43 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_pji_k12odevstack@QuobyteHD, size 112.00 MB, duration 3.50 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:14:43 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Converted 112.00 MB image at 32.02 MB/s Sep 28 18:14:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:43 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e 1G Sep 28 18:14:43 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:44 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e 1G" returned: 0 in 0.490s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Downloaded image 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 for user 06ab898eee5b494dae9f08440fcb0312 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Marking volume b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Copying metadata from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 to b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Creating volume glance metadata for volume b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e backed by image 052187e4-f9b0-4ab2-bf54-351fdb1df836 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c2bc5d-bfaf-446a-a251-0845ab8e29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23898482-011e-4f36-84a8-057cee0a412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:44 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Volume volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e (b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e): created successfully Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23898482-011e-4f36-84a8-057cee0a412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Flow 'volume_create_manager' (2c0917a6-8d27-41c9-8b99-c041d01ceb41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:44 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d6115f74-3ba0-426e-9d8c-8dd568f47d6a tempest-VolumesImageMetadata-569836019 None] Created volume successfully. Sep 28 18:14:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Acquiring lock "cinder-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Lock "cinder-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Acquiring lock "cinder-quobyte-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Lock "cinder-quobyte-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e" acquired by "delete_volume" :: waited 0.065s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ec370-f878-459b-8375-d0d3cf96a847]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:46 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e Sep 28 18:14:46 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:47 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e" returned: 0 in 0.683s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:47 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e Sep 28 18:14:47 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:47 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e" returned: 0 in 0.501s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Lock "cinder-quobyte-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e" released by "delete_volume" :: held 1.312s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:47 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Created reservations ['bcb2c258-d3a8-4e6f-9eb9-92fda617cb1a', 'e9e119e2-8e08-4b94-a836-5e16aa4d2cb7', '14a3034d-ca86-4e97-bd1b-62867513f911', '09bdd788-0a4d-4ac3-b775-715b3f0bfa99'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:48 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:14:48 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:48 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.643s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Deleted volume successfully. Sep 28 18:14:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cd2fdd47-4b9b-4f44-b45f-8f139ef5791b tempest-VolumesImageMetadata-569836019 None] Lock "cinder-b5cc9ad6-ceb1-4a23-acd1-69d98f328a6e-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:58 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=43,cinder:UPDATE=48,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:58 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=43,cinder:INSERT=15,cinder:UPDATE=47,cinder:DELETE=4 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Flow 'volume_create_manager' (596efa9e-160f-4622-b6a6-d11bb442993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da23f4a1-f433-40a0-82c3-b96e7a675fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da23f4a1-f433-40a0-82c3-b96e7a675fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1711589765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a527303e-27aa-40ed-8458-b49debcd4b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='399c5b3d988c4c27a5ad21b11a8e6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:00Z,use_quota=True,user_id='cc3d04e8d9b245daa237e2c35be69098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3629033f-1bf6-43cf-ac3d-e844cfc35872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3629033f-1bf6-43cf-ac3d-e844cfc35872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d079d65e-a0ef-4a4d-85f4-32ed3924c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d079d65e-a0ef-4a4d-85f4-32ed3924c63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a527303e-27aa-40ed-8458-b49debcd4b99', 'volume_name': 'volume-a527303e-27aa-40ed-8458-b49debcd4b99', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d027b0eb-2b65-4390-a830-3870bd44b8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d027b0eb-2b65-4390-a830-3870bd44b8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd05f558-f407-4eb7-805b-6e054e3a9ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Volume a527303e-27aa-40ed-8458-b49debcd4b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a527303e-27aa-40ed-8458-b49debcd4b99', 'volume_size': 1} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1711589765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a527303e-27aa-40ed-8458-b49debcd4b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='399c5b3d988c4c27a5ad21b11a8e6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:00Z,use_quota=True,user_id='cc3d04e8d9b245daa237e2c35be69098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Creating volume a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:00 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:15:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:00 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 1073741824 Sep 28 18:15:00 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:01 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 1073741824" returned: 0 in 0.866s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:01 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:15:01 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:01 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.435s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd05f558-f407-4eb7-805b-6e054e3a9ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a527303e-27aa-40ed-8458-b49debcd4b99', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71687e3e-cd48-4579-84a3-21f42bdc6bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:02 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Volume volume-a527303e-27aa-40ed-8458-b49debcd4b99 (a527303e-27aa-40ed-8458-b49debcd4b99): created successfully Sep 28 18:15:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71687e3e-cd48-4579-84a3-21f42bdc6bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Flow 'volume_create_manager' (596efa9e-160f-4622-b6a6-d11bb442993f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:02 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0a353765-4d51-4238-98c9-e2aeee545875 tempest-VolumesActionsTest-477795194 None] Created volume successfully. Sep 28 18:15:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-15e29413-defa-4311-88e3-d2f18047b46e req-09a7d30e-6367-4627-94b8-478bcd1d6882 tempest-AttachVolumeTestJSON-115702562 None] Terminate volume connection completed successfully. Sep 28 18:15:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-15e29413-defa-4311-88e3-d2f18047b46e req-09a7d30e-6367-4627-94b8-478bcd1d6882 tempest-AttachVolumeTestJSON-115702562 None] Deleting attachment bdeb0eb0-77c5-4f79-91ce-b35b0a42deac. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Flow 'volume_create_manager' (7b95c94e-968d-4503-8c47-fd69ac8b46c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501cde5b-71f8-48c4-be6c-fa6c0646c9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501cde5b-71f8-48c4-be6c-fa6c0646c9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1352315788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80a54c6-a08e-4d42-8673-96059e44fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d008802af55e46f88ac54473988c046b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:13Z,use_quota=True,user_id='5bcff81f78fa4c4db803f7df25ab13be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ef2a3e-9729-44ed-a995-2a5d8b73a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ef2a3e-9729-44ed-a995-2a5d8b73a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e2be25-b7c4-4784-bb0b-3bdbd69194e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e2be25-b7c4-4784-bb0b-3bdbd69194e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80a54c6-a08e-4d42-8673-96059e44fea0', 'volume_name': 'volume-c80a54c6-a08e-4d42-8673-96059e44fea0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c36ac8-bb5a-4520-b5e1-7a46383b61ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c36ac8-bb5a-4520-b5e1-7a46383b61ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ba5f0f-8db2-4a44-9bcb-dad91a0b40b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Volume c80a54c6-a08e-4d42-8673-96059e44fea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80a54c6-a08e-4d42-8673-96059e44fea0', 'volume_size': 1} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1352315788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80a54c6-a08e-4d42-8673-96059e44fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d008802af55e46f88ac54473988c046b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:13Z,use_quota=True,user_id='5bcff81f78fa4c4db803f7df25ab13be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Creating volume c80a54c6-a08e-4d42-8673-96059e44fea0 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:13 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:15:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:14 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 1073741824 Sep 28 18:15:14 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:15 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 1073741824" returned: 0 in 1.630s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:15 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 Sep 28 18:15:15 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:16 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0" returned: 0 in 0.766s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] <== create_volume: return (2532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.544s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ba5f0f-8db2-4a44-9bcb-dad91a0b40b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80a54c6-a08e-4d42-8673-96059e44fea0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cb83da-be22-46c0-a9e5-f17034b81e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:16 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Volume volume-c80a54c6-a08e-4d42-8673-96059e44fea0 (c80a54c6-a08e-4d42-8673-96059e44fea0): created successfully Sep 28 18:15:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cb83da-be22-46c0-a9e5-f17034b81e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Flow 'volume_create_manager' (7b95c94e-968d-4503-8c47-fd69ac8b46c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7c2e39d9-b2a4-43ad-86d2-cc287b5b925c tempest-VolumesTransfersTest-850603191 None] Created volume successfully. Sep 28 18:15:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-24680367-49cc-4950-b5bb-5528d446327f tempest-VolumesTransfersTest-2075491157 None] Transfer volume completed successfully. Sep 28 18:15:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Acquiring lock "cinder-c80a54c6-a08e-4d42-8673-96059e44fea0-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-c80a54c6-a08e-4d42-8673-96059e44fea0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Acquiring lock "cinder-quobyte-c80a54c6-a08e-4d42-8673-96059e44fea0" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-quobyte-c80a54c6-a08e-4d42-8673-96059e44fea0" acquired by "delete_volume" :: waited 0.053s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c3cd9-c3a8-4866-9bac-cc8f0492906c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:22 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 Sep 28 18:15:22 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:23 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0" returned: 0 in 1.196s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:23 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0 Sep 28 18:15:23 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:23 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c80a54c6-a08e-4d42-8673-96059e44fea0" returned: 0 in 0.495s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-quobyte-c80a54c6-a08e-4d42-8673-96059e44fea0" released by "delete_volume" :: held 1.857s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Created reservations ['2a2ecd68-458e-4ada-be16-516c7110335e', '5fa89fca-838c-4437-92fd-d71a3d2f2c26', 'ddf1159c-1d0e-4cc7-ac03-18920dbe1870', 'e03a9d84-6886-4cf3-8b60-0ff2e479272d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:24 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:15:24 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:24 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.471s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:24 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:24 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Deleted volume successfully. Sep 28 18:15:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0e943e4d-d08a-476c-a3da-9d5ebd32bae3 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-c80a54c6-a08e-4d42-8673-96059e44fea0-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394ff1a4-eccb-4633-8648-593b0e2179e6 tempest-VolumesActionsTest-477795194 None] Acquiring lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99" by "attach_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394ff1a4-eccb-4633-8648-593b0e2179e6 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99" acquired by "attach_volume" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-394ff1a4-eccb-4633-8648-593b0e2179e6 tempest-VolumesActionsTest-477795194 None] Attaching volume a527303e-27aa-40ed-8458-b49debcd4b99 to instance a91b69e2-9bb3-41b9-921f-75d4252e437e at mountpoint /dev/vdb on host None. Sep 28 18:15:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-394ff1a4-eccb-4633-8648-593b0e2179e6 tempest-VolumesActionsTest-477795194 None] Attach volume completed successfully. Sep 28 18:15:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394ff1a4-eccb-4633-8648-593b0e2179e6 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99" released by "attach_volume" :: held 0.260s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-81325afa-3cd5-4f91-9141-f0a252ecb5be tempest-VolumesActionsTest-477795194 None] Acquiring lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-detach_volume" by "detach_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-81325afa-3cd5-4f91-9141-f0a252ecb5be tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-81325afa-3cd5-4f91-9141-f0a252ecb5be tempest-VolumesActionsTest-477795194 None] Detaching volume a527303e-27aa-40ed-8458-b49debcd4b99 from instance a91b69e2-9bb3-41b9-921f-75d4252e437e. Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Flow 'volume_create_manager' (07d63efe-ef7b-4852-8037-3783cb03d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5ae071-c081-4678-9df7-3653eca9bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5ae071-c081-4678-9df7-3653eca9bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1870053833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622c55d5-fd6d-4835-9410-28771a8385a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d008802af55e46f88ac54473988c046b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:26Z,use_quota=True,user_id='5bcff81f78fa4c4db803f7df25ab13be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaab12f-e50a-4cfe-a3b3-459d02aa099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaab12f-e50a-4cfe-a3b3-459d02aa099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d763971b-b621-4c15-9c37-bfbcbdf17227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d763971b-b621-4c15-9c37-bfbcbdf17227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622c55d5-fd6d-4835-9410-28771a8385a9', 'volume_name': 'volume-622c55d5-fd6d-4835-9410-28771a8385a9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dc0e3c-e95f-43db-804c-4003872b3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dc0e3c-e95f-43db-804c-4003872b3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f990975d-95bc-480e-b9d1-16677d2d4310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Volume 622c55d5-fd6d-4835-9410-28771a8385a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622c55d5-fd6d-4835-9410-28771a8385a9', 'volume_size': 1} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1870053833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622c55d5-fd6d-4835-9410-28771a8385a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d008802af55e46f88ac54473988c046b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:26Z,use_quota=True,user_id='5bcff81f78fa4c4db803f7df25ab13be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Creating volume 622c55d5-fd6d-4835-9410-28771a8385a9 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:26 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:26 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 1073741824 Sep 28 18:15:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-81325afa-3cd5-4f91-9141-f0a252ecb5be tempest-VolumesActionsTest-477795194 None] Detach volume completed successfully. Sep 28 18:15:26 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-81325afa-3cd5-4f91-9141-f0a252ecb5be tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-detach_volume" released by "detach_volume" :: held 0.396s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:27 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 1073741824" returned: 0 in 1.248s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:27 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 Sep 28 18:15:27 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:28 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9" returned: 0 in 0.914s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f990975d-95bc-480e-b9d1-16677d2d4310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622c55d5-fd6d-4835-9410-28771a8385a9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e2cb8b-1fc4-42b4-b5f4-3535f343bedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Volume volume-622c55d5-fd6d-4835-9410-28771a8385a9 (622c55d5-fd6d-4835-9410-28771a8385a9): created successfully Sep 28 18:15:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e2cb8b-1fc4-42b4-b5f4-3535f343bedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Flow 'volume_create_manager' (07d63efe-ef7b-4852-8037-3783cb03d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0810a358-276e-40f8-be02-df0845581dde tempest-VolumesTransfersTest-850603191 None] Created volume successfully. Sep 28 18:15:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Acquiring lock "cinder-622c55d5-fd6d-4835-9410-28771a8385a9-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-622c55d5-fd6d-4835-9410-28771a8385a9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Acquiring lock "cinder-quobyte-622c55d5-fd6d-4835-9410-28771a8385a9" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-quobyte-622c55d5-fd6d-4835-9410-28771a8385a9" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c88fa17-4ec7-4027-bd83-ea2c0bef1cf8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:30 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 Sep 28 18:15:30 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:31 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9" returned: 0 in 0.790s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:31 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9 Sep 28 18:15:31 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:31 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-622c55d5-fd6d-4835-9410-28771a8385a9" returned: 0 in 0.518s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-quobyte-622c55d5-fd6d-4835-9410-28771a8385a9" released by "delete_volume" :: held 1.415s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Created reservations ['9a956491-6a76-4bf4-9961-94faf94be14f', '63ad3d8f-1f1b-49ea-98f7-2138b7198cc3', '43ed2a3b-c0ea-482e-b2a9-d5c8b6290e06', '37bbf8c6-c100-42a8-931d-8ab4ca1004d4'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:32 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:15:32 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:32 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.574s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:32 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Deleted volume successfully. Sep 28 18:15:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90dbcda1-b644-4532-8874-abef6c53c4b5 tempest-VolumesTransfersTest-1704720375 None] Lock "cinder-622c55d5-fd6d-4835-9410-28771a8385a9-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:38 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:15:38 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:39 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.551s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:15:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:15:42 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=31,cinder:SELECT=24,cinder:INSERT=6 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:42 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Flow 'volume_create_manager' (316dc875-9e60-45e8-ae9f-b1caf07cd4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a996cd4-8f7b-438b-b6bb-2b4950c95831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a996cd4-8f7b-438b-b6bb-2b4950c95831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-734162615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cee4744-cffe-4ab2-8ba9-6f9345fef304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a810daa9604e0cb6df0bbe7fa421f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:46Z,use_quota=True,user_id='07828b7b71a4480c96aad08d0bac6b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906c367f-3c78-4817-a874-e6f04021b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906c367f-3c78-4817-a874-e6f04021b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a1340e-779a-4116-b553-54f1bdaab70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a1340e-779a-4116-b553-54f1bdaab70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cee4744-cffe-4ab2-8ba9-6f9345fef304', 'volume_name': 'volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba9cf5b-418d-42f5-ac77-2a20d126b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba9cf5b-418d-42f5-ac77-2a20d126b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e2d9e1-10d1-47ac-9b83-b7ff7af187fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Volume 1cee4744-cffe-4ab2-8ba9-6f9345fef304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304', 'volume_size': 1} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-734162615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cee4744-cffe-4ab2-8ba9-6f9345fef304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a810daa9604e0cb6df0bbe7fa421f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:46Z,use_quota=True,user_id='07828b7b71a4480c96aad08d0bac6b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Creating volume 1cee4744-cffe-4ab2-8ba9-6f9345fef304 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:45 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:15:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:45 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 1073741824 Sep 28 18:15:45 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Flow 'volume_create_manager' (ba5a95f9-4785-4860-be31-2bf00ee0a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7817571c-4c9b-4884-82ea-9ce5da1f098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:46 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7817571c-4c9b-4884-82ea-9ce5da1f098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1456731852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ddf0875d49a891783726de97cd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:47Z,use_quota=True,user_id='97e823bf24654bfc97c5f98441798824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e193238f-45fa-4dd1-9ec8-0d4a3eaf976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e193238f-45fa-4dd1-9ec8-0d4a3eaf976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d68b26d-0a10-4b03-874e-d70bc6fe3594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d68b26d-0a10-4b03-874e-d70bc6fe3594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838', 'volume_name': 'volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5974b5-4d12-416e-86e4-98f71a9c3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5974b5-4d12-416e-86e4-98f71a9c3137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc2e1dc-d30c-4fc4-999e-6b835f7f71d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:46 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Volume fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838', 'volume_size': 1} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 1073741824" returned: 0 in 0.820s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:46 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 Sep 28 18:15:46 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:47 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304" returned: 0 in 0.392s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1456731852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ddf0875d49a891783726de97cd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:47Z,use_quota=True,user_id='97e823bf24654bfc97c5f98441798824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Creating volume fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:47 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:47 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 1073741824 Sep 28 18:15:47 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e2d9e1-10d1-47ac-9b83-b7ff7af187fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ae4893-4720-4786-8bbc-05951363e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Volume volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 (1cee4744-cffe-4ab2-8ba9-6f9345fef304): created successfully Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ae4893-4720-4786-8bbc-05951363e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Flow 'volume_create_manager' (316dc875-9e60-45e8-ae9f-b1caf07cd4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:47 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-43912987-e5b4-4b1d-bf69-9bab185ee3ab tempest-VolumesNegativeTest-1696189481 None] Created volume successfully. Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d64c4440-cfb9-41dd-a219-11cb019d8de0 tempest-VolumesActionsTest-477795194 None] Acquiring lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99" by "attach_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d64c4440-cfb9-41dd-a219-11cb019d8de0 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99" acquired by "attach_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:47 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d64c4440-cfb9-41dd-a219-11cb019d8de0 tempest-VolumesActionsTest-477795194 None] Attaching volume a527303e-27aa-40ed-8458-b49debcd4b99 to instance 9dc628c2-d84d-4def-ad30-065ded0b0406 at mountpoint /dev/vdb on host None. Sep 28 18:15:47 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d64c4440-cfb9-41dd-a219-11cb019d8de0 tempest-VolumesActionsTest-477795194 None] Attach volume completed successfully. Sep 28 18:15:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d64c4440-cfb9-41dd-a219-11cb019d8de0 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99" released by "attach_volume" :: held 0.213s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:48 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 1073741824" returned: 0 in 0.958s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:48 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 Sep 28 18:15:48 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-861cc5ba-75c6-46b0-8376-0e2a11354d47 tempest-VolumesActionsTest-477795194 None] Acquiring lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-detach_volume" by "detach_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-861cc5ba-75c6-46b0-8376-0e2a11354d47 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-861cc5ba-75c6-46b0-8376-0e2a11354d47 tempest-VolumesActionsTest-477795194 None] Detaching volume a527303e-27aa-40ed-8458-b49debcd4b99 from instance 9dc628c2-d84d-4def-ad30-065ded0b0406. Sep 28 18:15:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-861cc5ba-75c6-46b0-8376-0e2a11354d47 tempest-VolumesActionsTest-477795194 None] Detach volume completed successfully. Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-861cc5ba-75c6-46b0-8376-0e2a11354d47 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-detach_volume" released by "detach_volume" :: held 0.189s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:48 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838" returned: 0 in 0.558s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc2e1dc-d30c-4fc4-999e-6b835f7f71d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bcdaf3-94fe-47ed-95ce-7f46bb984c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:48 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Volume volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 (fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838): created successfully Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bcdaf3-94fe-47ed-95ce-7f46bb984c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Flow 'volume_create_manager' (ba5a95f9-4785-4860-be31-2bf00ee0a532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-99c87dfb-2269-46e6-9aaf-930898bdcea2 tempest-AttachVolumeNegativeTest-1997790671 None] Created volume successfully. Sep 28 18:15:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-e514f5e3-ee81-42c6-ab86-209463d55516 req-02d06407-0cdf-4e4d-897f-d7a45f42acf7 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-e514f5e3-ee81-42c6-ab86-209463d55516 req-02d06407-0cdf-4e4d-897f-d7a45f42acf7 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-e514f5e3-ee81-42c6-ab86-209463d55516 req-02d06407-0cdf-4e4d-897f-d7a45f42acf7 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-e514f5e3-ee81-42c6-ab86-209463d55516 req-02d06407-0cdf-4e4d-897f-d7a45f42acf7 tempest-AttachVolumeNegativeTest-1997790671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ea918c8-dd88-46fb-9d8a-7721b95e4bf7', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-e514f5e3-ee81-42c6-ab86-209463d55516 req-02d06407-0cdf-4e4d-897f-d7a45f42acf7 tempest-AttachVolumeNegativeTest-1997790671 None] attachment_update completed successfully. Sep 28 18:15:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:56 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[452cbb4d-2bd8-4e24-a223-0f7875b5b5ff]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:56 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:15:56 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:57 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.827s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:57 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93c900e-56a5-483b-a71d-5f845090f327]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:57 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:15:57 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:58 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.731s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.b9c319a1-85f4-4f01-9c7b-2effd328d5d5vstxuwfh.img {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:58 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.b9c319a1-85f4-4f01-9c7b-2effd328d5d5vstxuwfh.img Sep 28 18:15:58 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:02 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:06 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:11 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.b9c319a1-85f4-4f01-9c7b-2effd328d5d5vstxuwfh.img" returned: 0 in 13.116s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e062a-1ba5-4d2c-88aa-2b04ff48fec0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:11 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:16:11 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:12 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.805s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:12 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99, size 1024.00 MB, duration 13.12 sec, destination /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.b9c319a1-85f4-4f01-9c7b-2effd328d5d5vstxuwfh.img {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:16:12 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Converted 1024.00 MB image at 78.06 MB/s Sep 28 18:16:12 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] b9c319a1-85f4-4f01-9c7b-2effd328d5d5 was raw, no need to convert to raw {{(pid=86981) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:16:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Acquiring lock "cinder-1cee4744-cffe-4ab2-8ba9-6f9345fef304-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Lock "cinder-1cee4744-cffe-4ab2-8ba9-6f9345fef304-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Acquiring lock "cinder-quobyte-1cee4744-cffe-4ab2-8ba9-6f9345fef304" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Lock "cinder-quobyte-1cee4744-cffe-4ab2-8ba9-6f9345fef304" acquired by "delete_volume" :: waited 0.058s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:31 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0102c0-081e-476f-9f33-07a693cc846e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:31 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 Sep 28 18:16:31 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:32 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304" returned: 0 in 0.949s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:32 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304 Sep 28 18:16:32 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:32 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1cee4744-cffe-4ab2-8ba9-6f9345fef304" returned: 0 in 0.678s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Lock "cinder-quobyte-1cee4744-cffe-4ab2-8ba9-6f9345fef304" released by "delete_volume" :: held 1.817s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:32 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Created reservations ['e8220eba-5ce2-459e-a5dc-5573ce918828', '53a6c1b3-b59f-467c-bbf2-b902bf059553', 'ead336f5-1260-46ce-a13e-6e55193c0b89', '1f10ba7c-c6ea-4e65-8520-e1582af5d924'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:33 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:16:33 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:33 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.544s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Deleted volume successfully. Sep 28 18:16:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29b933b8-3513-4bbe-a26e-f94fa3f70a33 tempest-VolumesNegativeTest-1696189481 None] Lock "cinder-1cee4744-cffe-4ab2-8ba9-6f9345fef304-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:38 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:16:38 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:39 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.608s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:16:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:16:43 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:43 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-c9c9ae2d-90cf-483e-861c-5b67e8873608 req-e5bd794c-1300-4ea9-9e7c-28ba2db79735 tempest-AttachVolumeNegativeTest-1997790671 None] Terminate volume connection completed successfully. Sep 28 18:16:54 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-c9c9ae2d-90cf-483e-861c-5b67e8873608 req-e5bd794c-1300-4ea9-9e7c-28ba2db79735 tempest-AttachVolumeNegativeTest-1997790671 None] Deleting attachment 4ea918c8-dd88-46fb-9d8a-7721b95e4bf7. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 58.268s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:54 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Uploaded volume to glance image-id: b9c319a1-85f4-4f01-9c7b-2effd328d5d5. {{(pid=86981) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:16:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fae927a3-92dd-45fe-9d82-ff351983c17d tempest-VolumesActionsTest-477795194 None] Copy volume to image completed successfully. Sep 28 18:16:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:57 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd28d25-7847-4d27-b316-cf9b3c514af4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:57 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:16:57 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:57 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.462s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:57 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9c5bd-3dc6-44ce-9503-8fff94535c6b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:57 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:16:57 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:58 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.446s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:58 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img Sep 28 18:16:58 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Flow 'volume_create_manager' (937b4e69-93ee-46b2-b2c7-3b40b7d345bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1425fa1-2e96-47f9-90d0-d0219c550cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1425fa1-2e96-47f9-90d0-d0219c550cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2014612263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e70bc3-3726-4b1e-ad40-3bf79c6f15c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba0c359dc37430b9e1de0481c9c4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:03Z,use_quota=True,user_id='49765d1a31894716bdddf9e564b65bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae1b245-4430-4db0-a1d0-de5478bd2889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae1b245-4430-4db0-a1d0-de5478bd2889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8135dcf3-f8b4-47d0-ba30-f75465794887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8135dcf3-f8b4-47d0-ba30-f75465794887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e70bc3-3726-4b1e-ad40-3bf79c6f15c3', 'volume_name': 'volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e81aad-ac7e-4985-a0c9-6905e057a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e81aad-ac7e-4985-a0c9-6905e057a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d259e0d-466b-4b0d-9477-a715eb627c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:03 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Volume 63e70bc3-3726-4b1e-ad40-3bf79c6f15c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3', 'volume_size': 1} Sep 28 18:17:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:08 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img" returned: 0 in 10.587s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b64ca1-dc00-42bf-8e75-f5e843f380fe]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:08 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:17:08 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:09 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.692s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:09 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99, size 1024.00 MB, duration 10.59 sec, destination /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:17:09 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Converted 1024.00 MB image at 96.70 MB/s Sep 28 18:17:09 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] bf9bacb8-a5d4-401d-81c6-07f4fba2e0ac was raw, converting to qcow2 {{(pid=86981) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 18:17:09 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[03265922-fb48-4e3e-a239-c7695523a9fd]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:09 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img Sep 28 18:17:09 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:09 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img" returned: 0 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:10 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img Sep 28 18:17:10 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:10 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img" returned: 1 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:17:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img /opt/stack/data/cinder/conversion/vol_upload_p5lk5og2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:10 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img /opt/stack/data/cinder/conversion/vol_upload_p5lk5og2 Sep 28 18:17:10 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:10 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img /opt/stack/data/cinder/conversion/vol_upload_p5lk5og2" returned: 0 in 0.314s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:10 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Image conversion details: src /opt/stack/data/cinder/conversion/a527303e-27aa-40ed-8458-b49debcd4b99.temp_image.bf9bacb8-a5d4-401d-81c6-07f4fba2e0achtjiru7n.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_p5lk5og2 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:17:10 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 18:17:10 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29b536-0f48-4a42-be61-0ce3b07b9395]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p5lk5og2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:10 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p5lk5og2 Sep 28 18:17:10 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:11 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p5lk5og2" returned: 0 in 0.448s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.895s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Uploaded volume to glance image-id: bf9bacb8-a5d4-401d-81c6-07f4fba2e0ac. {{(pid=86981) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.479s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2014612263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e70bc3-3726-4b1e-ad40-3bf79c6f15c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba0c359dc37430b9e1de0481c9c4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:03Z,use_quota=True,user_id='49765d1a31894716bdddf9e564b65bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Creating volume 63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:14 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:17:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3876e098-40eb-4f27-a78e-6edbf64f5ccf tempest-VolumesActionsTest-477795194 None] Copy volume to image completed successfully. Sep 28 18:17:14 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 1073741824 Sep 28 18:17:14 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:15 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 1073741824" returned: 0 in 1.099s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:15 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 Sep 28 18:17:15 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Acquiring lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:15 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3" returned: 0 in 0.682s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Acquiring lock "cinder-quobyte-a527303e-27aa-40ed-8458-b49debcd4b99" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d259e0d-466b-4b0d-9477-a715eb627c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce4bd6d-e25a-456e-87ef-7a9c5d43dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:16 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Volume volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 (63e70bc3-3726-4b1e-ad40-3bf79c6f15c3): created successfully Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce4bd6d-e25a-456e-87ef-7a9c5d43dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Flow 'volume_create_manager' (937b4e69-93ee-46b2-b2c7-3b40b7d345bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Lock "cinder-quobyte-a527303e-27aa-40ed-8458-b49debcd4b99" acquired by "delete_volume" :: waited 0.097s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d5daff0f-7eea-4742-af37-c2d43a9d8e6a tempest-AttachVolumeTestJSON-115702562 None] Created volume successfully. Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf04b41b-352e-4088-bb52-e25d1ad3b540]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:16 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:17:16 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:16 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.678s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:16 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99 Sep 28 18:17:16 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:17 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a527303e-27aa-40ed-8458-b49debcd4b99" returned: 0 in 0.735s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Lock "cinder-quobyte-a527303e-27aa-40ed-8458-b49debcd4b99" released by "delete_volume" :: held 1.508s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Created reservations ['9ea15937-da55-425b-9be4-164489ef54d9', '483ffd50-21a1-404a-a3ea-a171bd4f2fbe', '641655e6-da5f-4058-9458-088da5d88760', 'cc1a20fb-e4e7-41bc-99f7-5a7b290bfbdb'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:18 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:17:18 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:18 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.552s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Deleted volume successfully. Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-a00bdabf-4597-405f-a327-97979724e33b req-307e777c-5610-412c-94fa-9b09cf81a604 tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-a00bdabf-4597-405f-a327-97979724e33b req-307e777c-5610-412c-94fa-9b09cf81a604 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-a00bdabf-4597-405f-a327-97979724e33b req-307e777c-5610-412c-94fa-9b09cf81a604 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7009b99a-bd84-49b4-8eea-39f2bc229ee4 tempest-VolumesActionsTest-477795194 None] Lock "cinder-a527303e-27aa-40ed-8458-b49debcd4b99-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-a00bdabf-4597-405f-a327-97979724e33b req-307e777c-5610-412c-94fa-9b09cf81a604 tempest-AttachVolumeTestJSON-115702562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb6a7222-2df1-4b16-ad7b-cc42d481bf35', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-a00bdabf-4597-405f-a327-97979724e33b req-307e777c-5610-412c-94fa-9b09cf81a604 tempest-AttachVolumeTestJSON-115702562 None] attachment_update completed successfully. Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Flow 'volume_create_manager' (78528bd0-9a31-41a3-ab05-ddc6a73a91a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbebb06-40ea-4d0a-8bbf-1a92c4fabe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbebb06-40ea-4d0a-8bbf-1a92c4fabe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2147307080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795b8b29-f9e3-40f9-98f1-a5f6c5fed36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba0c359dc37430b9e1de0481c9c4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:23Z,use_quota=True,user_id='49765d1a31894716bdddf9e564b65bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf29ae8-75ff-4d92-8d63-38645cec8397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf29ae8-75ff-4d92-8d63-38645cec8397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f1c608-bda1-41e8-b171-c358121ce0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f1c608-bda1-41e8-b171-c358121ce0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795b8b29-f9e3-40f9-98f1-a5f6c5fed36c', 'volume_name': 'volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb330e29-d76c-4f49-a91b-a2a5a70ac89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb330e29-d76c-4f49-a91b-a2a5a70ac89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303ea8a3-1cc3-4221-8820-926db986b283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Volume 795b8b29-f9e3-40f9-98f1-a5f6c5fed36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c', 'volume_size': 1} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2147307080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795b8b29-f9e3-40f9-98f1-a5f6c5fed36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba0c359dc37430b9e1de0481c9c4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:23Z,use_quota=True,user_id='49765d1a31894716bdddf9e564b65bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Creating volume 795b8b29-f9e3-40f9-98f1-a5f6c5fed36c {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:23 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:17:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:23 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c 1073741824 Sep 28 18:17:23 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:24 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c 1073741824" returned: 0 in 0.837s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:24 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c Sep 28 18:17:24 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:25 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c" returned: 0 in 0.560s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303ea8a3-1cc3-4221-8820-926db986b283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec861d6-ee52-4433-a58d-16053a4dc5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:25 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Volume volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c (795b8b29-f9e3-40f9-98f1-a5f6c5fed36c): created successfully Sep 28 18:17:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec861d6-ee52-4433-a58d-16053a4dc5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Flow 'volume_create_manager' (78528bd0-9a31-41a3-ab05-ddc6a73a91a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-dbeee183-4db6-47c6-9d83-a14cc3a6b7a7 tempest-AttachVolumeTestJSON-115702562 None] Created volume successfully. Sep 28 18:17:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-85c8eb88-ff5e-46c0-a92e-7d1540915f6f req-47b6e42c-c474-47cb-9e8d-3cf881c44848 tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-85c8eb88-ff5e-46c0-a92e-7d1540915f6f req-47b6e42c-c474-47cb-9e8d-3cf881c44848 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-85c8eb88-ff5e-46c0-a92e-7d1540915f6f req-47b6e42c-c474-47cb-9e8d-3cf881c44848 tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-85c8eb88-ff5e-46c0-a92e-7d1540915f6f req-47b6e42c-c474-47cb-9e8d-3cf881c44848 tempest-AttachVolumeTestJSON-115702562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8905d83c-ef93-464c-ac37-97ec0d7401b1', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:29 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-85c8eb88-ff5e-46c0-a92e-7d1540915f6f req-47b6e42c-c474-47cb-9e8d-3cf881c44848 tempest-AttachVolumeTestJSON-115702562 None] attachment_update completed successfully. Sep 28 18:17:34 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-dca3b254-c63c-4b01-9cae-f7f3a44d8ba2 req-24b97d06-451b-4455-9e7b-711d1f195314 tempest-AttachVolumeTestJSON-115702562 None] Terminate volume connection completed successfully. Sep 28 18:17:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-dca3b254-c63c-4b01-9cae-f7f3a44d8ba2 req-24b97d06-451b-4455-9e7b-711d1f195314 tempest-AttachVolumeTestJSON-115702562 None] Deleting attachment eb6a7222-2df1-4b16-ad7b-cc42d481bf35. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:17:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-234a14b1-3093-4aa2-ac94-b48884c3e8b7 req-2de5d27d-5940-488b-9dd7-82d19cee03ae tempest-AttachVolumeTestJSON-115702562 None] Terminate volume connection completed successfully. Sep 28 18:17:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-234a14b1-3093-4aa2-ac94-b48884c3e8b7 req-2de5d27d-5940-488b-9dd7-82d19cee03ae tempest-AttachVolumeTestJSON-115702562 None] Deleting attachment 8905d83c-ef93-464c-ac37-97ec0d7401b1. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:17:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:38 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:17:38 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:39 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.478s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:17:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Flow 'volume_create_manager' (7e2fff39-93f4-490a-8c56-fac00b98932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c56bb5-306f-460d-bed1-177aae47a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c56bb5-306f-460d-bed1-177aae47a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-930537098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525b0ae7-bb0c-420d-a6c3-b40c818f503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6b818fc4d4faaa6539ff181c7f88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:41Z,use_quota=True,user_id='3266bd2b8f1d4708b8f3977b52f2a948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1be072-9e2e-4015-be3b-3fc3efd4acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1be072-9e2e-4015-be3b-3fc3efd4acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45366aa7-ddda-49e0-bb02-c8620e48a0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45366aa7-ddda-49e0-bb02-c8620e48a0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525b0ae7-bb0c-420d-a6c3-b40c818f503e', 'volume_name': 'volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e', 'volume_size': 2}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89243138-07c8-4716-a214-4a58bac7bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89243138-07c8-4716-a214-4a58bac7bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a26bc6c-f6d8-4be6-b47d-8832d63b8c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:40 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Volume 525b0ae7-bb0c-420d-a6c3-b40c818f503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e', 'volume_size': 2} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-930537098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525b0ae7-bb0c-420d-a6c3-b40c818f503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6b818fc4d4faaa6539ff181c7f88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:41Z,use_quota=True,user_id='3266bd2b8f1d4708b8f3977b52f2a948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Creating volume 525b0ae7-bb0c-420d-a6c3-b40c818f503e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:40 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:17:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e 2147483648 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:40 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e 2147483648 Sep 28 18:17:40 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:41 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e 2147483648" returned: 0 in 0.708s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:41 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e Sep 28 18:17:41 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:41 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e" returned: 0 in 0.421s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a26bc6c-f6d8-4be6-b47d-8832d63b8c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e', 'volume_size': 2}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3925b24e-128e-4ad9-9855-47857405c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:42 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Volume volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e (525b0ae7-bb0c-420d-a6c3-b40c818f503e): created successfully Sep 28 18:17:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3925b24e-128e-4ad9-9855-47857405c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Flow 'volume_create_manager' (7e2fff39-93f4-490a-8c56-fac00b98932f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8bf6adb2-de98-4485-be7c-d1fa7dd25a58 tempest-VolumesCloneNegativeTest-874371166 None] Created volume successfully. Sep 28 18:17:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Acquiring lock "cinder-525b0ae7-bb0c-420d-a6c3-b40c818f503e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Lock "cinder-525b0ae7-bb0c-420d-a6c3-b40c818f503e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Acquiring lock "cinder-quobyte-525b0ae7-bb0c-420d-a6c3-b40c818f503e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Lock "cinder-quobyte-525b0ae7-bb0c-420d-a6c3-b40c818f503e" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:43 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be6ebb-7fcb-4ba6-b6c4-d77cd9a0d6cf]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:43 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e Sep 28 18:17:43 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:44 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e" returned: 0 in 0.682s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:44 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e Sep 28 18:17:44 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:44 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-525b0ae7-bb0c-420d-a6c3-b40c818f503e" returned: 0 in 0.395s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Lock "cinder-quobyte-525b0ae7-bb0c-420d-a6c3-b40c818f503e" released by "delete_volume" :: held 1.188s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:44 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Created reservations ['b29b0750-5152-4817-9294-aa6541dbd8de', '93c40db2-3e1b-4234-ad92-8f316b71aacf', 'a308725a-590d-4d1b-b736-ba1390a8b5f6', 'd6056803-a0f3-4c54-a002-fa1fcd09a1c2'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:45 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:17:45 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:45 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:45 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Deleted volume successfully. Sep 28 18:17:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-55328e31-1b80-4cf2-8dad-20fdd651b8b9 tempest-VolumesCloneNegativeTest-874371166 None] Lock "cinder-525b0ae7-bb0c-420d-a6c3-b40c818f503e-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "cinder-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "cinder-quobyte-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-quobyte-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c" acquired by "delete_volume" :: waited 0.085s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9662b5-5a05-4d48-853d-89b209907aa2]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:47 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c Sep 28 18:17:47 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:47 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c" returned: 0 in 0.905s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:47 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c Sep 28 18:17:47 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:48 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c" returned: 0 in 0.481s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-quobyte-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c" released by "delete_volume" :: held 1.596s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Created reservations ['9a043465-9496-4794-9036-4656c1120782', 'd06dd1df-7566-4121-a10c-d7e68627ee2a', '7846dc6c-103b-4968-9481-a42ef62eb538', '268dc122-3253-415f-b73f-7566cda4b489'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:48 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:17:48 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:49 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.550s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "cinder-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Deleted volume successfully. Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5ed9e7f0-a12c-4a7a-84fa-2ea7e41b8f0e tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-795b8b29-f9e3-40f9-98f1-a5f6c5fed36c-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "cinder-quobyte-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-quobyte-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e3ec9d-432f-4274-8665-a88e1b79a506]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:49 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 Sep 28 18:17:49 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:50 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3" returned: 0 in 0.792s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:50 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3 Sep 28 18:17:50 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Flow 'volume_create_manager' (d4542db7-13cd-4008-a7bc-4c718bb1c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c007a42-e40e-4996-8299-2af11f429a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c007a42-e40e-4996-8299-2af11f429a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-221361314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9101ed5-7488-474a-8767-e3f957809676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ed67ec49044a85ad173466f8abefa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:51Z,use_quota=True,user_id='1b3311d968e44cb28271ea1facafdb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750f4b6c-56b8-49ea-aa1f-f2f0efc74ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750f4b6c-56b8-49ea-aa1f-f2f0efc74ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79eb2f21-8ebf-40a6-8ce1-a23cf7f60b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79eb2f21-8ebf-40a6-8ce1-a23cf7f60b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9101ed5-7488-474a-8767-e3f957809676', 'volume_name': 'volume-a9101ed5-7488-474a-8767-e3f957809676', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a85adb-0ce7-4c7a-af33-5a6fddcccc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a85adb-0ce7-4c7a-af33-5a6fddcccc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116a4ad5-a7e4-4bc1-b2e8-d41a38ce7938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Volume a9101ed5-7488-474a-8767-e3f957809676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9101ed5-7488-474a-8767-e3f957809676', 'volume_size': 1} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-221361314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9101ed5-7488-474a-8767-e3f957809676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ed67ec49044a85ad173466f8abefa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:51Z,use_quota=True,user_id='1b3311d968e44cb28271ea1facafdb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Creating volume a9101ed5-7488-474a-8767-e3f957809676 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:51 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3" returned: 0 in 0.878s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-quobyte-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3" released by "delete_volume" :: held 1.762s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:51 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 1073741824 Sep 28 18:17:51 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Flow 'volume_create_manager' (c3a66af8-47e4-485a-875d-c70c6c1f6783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f37bc-671b-4332-9c9f-2b02410a37ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15f37bc-671b-4332-9c9f-2b02410a37ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-305194248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd18c38-75dc-4a5d-be68-0861dbdc63f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ddf0875d49a891783726de97cd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:51Z,use_quota=True,user_id='97e823bf24654bfc97c5f98441798824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf131e7-19e1-4898-8a60-0414c1123455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf131e7-19e1-4898-8a60-0414c1123455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e74fce-9b4d-4d88-8c20-125def52ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e74fce-9b4d-4d88-8c20-125def52ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd18c38-75dc-4a5d-be68-0861dbdc63f3', 'volume_name': 'volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fa0077-cdf9-4e55-8005-fae7dec073a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fa0077-cdf9-4e55-8005-fae7dec073a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e948271-00a2-4ac0-bb70-213ff54104f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:51 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Volume 5bd18c38-75dc-4a5d-be68-0861dbdc63f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3', 'volume_size': 1} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Created reservations ['dc74d8e4-6893-4f81-9984-0ba94f3ab342', 'ae8fe7b7-0516-4ce2-bd9b-0dc6e65bea33', 'c4be858e-2911-4a90-9a1e-7e8a4526b23e', '0c260f7f-a56d-41e8-9d6e-c6765333190b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:51 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:17:51 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:52 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 1073741824" returned: 0 in 0.857s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "cinder-d60eedfc-7827-4822-ab4a-74cb59d0d827-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:52 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 Sep 28 18:17:52 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:52 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.603s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-d60eedfc-7827-4822-ab4a-74cb59d0d827-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Deleted volume successfully. Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-459c4734-8cf2-4101-b6b4-5c8e3f3b20aa tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-63e70bc3-3726-4b1e-ad40-3bf79c6f15c3-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "cinder-quobyte-d60eedfc-7827-4822-ab4a-74cb59d0d827" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-quobyte-d60eedfc-7827-4822-ab4a-74cb59d0d827" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a6b520-4695-4182-b8ae-3a706cedc466]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:52 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 Sep 28 18:17:52 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:52 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676" returned: 0 in 0.620s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-305194248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd18c38-75dc-4a5d-be68-0861dbdc63f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ddf0875d49a891783726de97cd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:51Z,use_quota=True,user_id='97e823bf24654bfc97c5f98441798824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Creating volume 5bd18c38-75dc-4a5d-be68-0861dbdc63f3 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:52 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:52 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 1073741824 Sep 28 18:17:52 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116a4ad5-a7e4-4bc1-b2e8-d41a38ce7938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9101ed5-7488-474a-8767-e3f957809676', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86685b3a-627e-4063-9997-6f66b394a9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:52 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Volume volume-a9101ed5-7488-474a-8767-e3f957809676 (a9101ed5-7488-474a-8767-e3f957809676): created successfully Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86685b3a-627e-4063-9997-6f66b394a9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Flow 'volume_create_manager' (d4542db7-13cd-4008-a7bc-4c718bb1c557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e70afcb8-440c-4662-8082-93a7349bd92d tempest-TestMinimumBasicScenario-644304430 None] Created volume successfully. Sep 28 18:17:53 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827" returned: 0 in 0.694s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:53 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827 Sep 28 18:17:53 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:53 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d60eedfc-7827-4822-ab4a-74cb59d0d827" returned: 0 in 0.544s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-quobyte-d60eedfc-7827-4822-ab4a-74cb59d0d827" released by "delete_volume" :: held 1.315s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=53,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=46,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:53 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 1073741824" returned: 0 in 1.013s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Created reservations ['a742f57a-4307-400a-a4d6-aace0095619b', '43a7f19f-f5b0-4be7-adc9-14b6a8efb0e9', '3c640e20-86d1-425f-90f0-aa10162ebc69', 'e96c09d8-fc9b-43ac-9b7a-131e89c32c4e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:54 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 Sep 28 18:17:54 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:54 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:17:54 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:54 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3" returned: 0 in 0.929s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e948271-00a2-4ac0-bb70-213ff54104f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c51806-cfe6-4b41-af71-2fe8623654c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:55 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Volume volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 (5bd18c38-75dc-4a5d-be68-0861dbdc63f3): created successfully Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c51806-cfe6-4b41-af71-2fe8623654c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Flow 'volume_create_manager' (c3a66af8-47e4-485a-875d-c70c6c1f6783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2d4ee700-c445-4108-bcd9-397cd7271d05 tempest-AttachVolumeNegativeTest-1997790671 None] Created volume successfully. Sep 28 18:17:55 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.947s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Deleted volume successfully. Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d772ff3-bd9b-4169-8fa2-5f8c0f3cebbf tempest-AttachVolumeTestJSON-115702562 None] Lock "cinder-d60eedfc-7827-4822-ab4a-74cb59d0d827-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8cc6695e-3d3f-495d-a5db-4fc70bd7978d req-6083f38c-ff5e-42d9-9146-3b618df1c8e0 tempest-TestMinimumBasicScenario-644304430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8cc6695e-3d3f-495d-a5db-4fc70bd7978d req-6083f38c-ff5e-42d9-9146-3b618df1c8e0 tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8cc6695e-3d3f-495d-a5db-4fc70bd7978d req-6083f38c-ff5e-42d9-9146-3b618df1c8e0 tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-8cc6695e-3d3f-495d-a5db-4fc70bd7978d req-6083f38c-ff5e-42d9-9146-3b618df1c8e0 tempest-TestMinimumBasicScenario-644304430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-a9101ed5-7488-474a-8767-e3f957809676', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b7a9f65-b1e2-427f-a410-4a1f7b448869', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-8cc6695e-3d3f-495d-a5db-4fc70bd7978d req-6083f38c-ff5e-42d9-9146-3b618df1c8e0 tempest-TestMinimumBasicScenario-644304430 None] attachment_update completed successfully. Sep 28 18:17:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-f24b094c-c292-4c69-8054-6cf539359b9e req-f5af66fc-694e-4cea-9493-92cceb7351e5 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-f24b094c-c292-4c69-8054-6cf539359b9e req-f5af66fc-694e-4cea-9493-92cceb7351e5 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-f24b094c-c292-4c69-8054-6cf539359b9e req-f5af66fc-694e-4cea-9493-92cceb7351e5 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-f24b094c-c292-4c69-8054-6cf539359b9e req-f5af66fc-694e-4cea-9493-92cceb7351e5 tempest-AttachVolumeNegativeTest-1997790671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '488698ad-79a0-4706-af0e-00d1d59ad614', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-f24b094c-c292-4c69-8054-6cf539359b9e req-f5af66fc-694e-4cea-9493-92cceb7351e5 tempest-AttachVolumeNegativeTest-1997790671 None] attachment_update completed successfully. Sep 28 18:18:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-62545fc1-2cc9-49ef-8579-33e105f9d249 req-23fba69e-dd29-407f-a70f-ccc81178b459 tempest-AttachVolumeNegativeTest-1997790671 None] Terminate volume connection completed successfully. Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-62545fc1-2cc9-49ef-8579-33e105f9d249 req-23fba69e-dd29-407f-a70f-ccc81178b459 tempest-AttachVolumeNegativeTest-1997790671 None] Deleting attachment 488698ad-79a0-4706-af0e-00d1d59ad614. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Flow 'volume_create_manager' (5e15bd8f-8fad-44c9-892c-5faffdc6be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9143aaf7-46f7-4831-a314-32f20d9bc29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9143aaf7-46f7-4831-a314-32f20d9bc29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-810290296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc50fc-8c7e-4460-a9c4-0bc561776d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2991ed22cd9e4417b19be282459e6d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:03Z,use_quota=True,user_id='b344bc6106a24df19c44a9e445c71858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85d0a64-2d1d-4b59-a92d-5cac1beeeaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85d0a64-2d1d-4b59-a92d-5cac1beeeaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b6c5e4-51a2-47a0-9c5b-56e75a2620f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b6c5e4-51a2-47a0-9c5b-56e75a2620f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfc50fc-8c7e-4460-a9c4-0bc561776d18', 'volume_name': 'volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc1e82-d856-436b-8c28-782232906a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc1e82-d856-436b-8c28-782232906a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021efa7f-249c-4126-8983-c9936b4bc872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:03 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18', 'volume_size': 1} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-810290296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc50fc-8c7e-4460-a9c4-0bc561776d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2991ed22cd9e4417b19be282459e6d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:03Z,use_quota=True,user_id='b344bc6106a24df19c44a9e445c71858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Creating volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:03 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:18:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:03 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 1073741824 Sep 28 18:18:03 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:04 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 1073741824" returned: 0 in 0.690s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:04 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 Sep 28 18:18:04 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:05 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" returned: 0 in 0.496s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021efa7f-249c-4126-8983-c9936b4bc872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d604a2-b729-472c-bf67-7dc9b33f481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:05 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Volume volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 (bbfc50fc-8c7e-4460-a9c4-0bc561776d18): created successfully Sep 28 18:18:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d604a2-b729-472c-bf67-7dc9b33f481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Flow 'volume_create_manager' (5e15bd8f-8fad-44c9-892c-5faffdc6be6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:05 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f7665e6b-e5c1-4cb0-b804-f55aa02c32e3 tempest-VolumesSnapshotListTestJSON-1136430222 None] Created volume successfully. Sep 28 18:18:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Creating offline snapshot 973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd of volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:18:06 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59789df-e35c-4c8d-bfd1-ad2efd73b2fa]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:06 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 Sep 28 18:18:06 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:07 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" returned: 0 in 0.685s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:07 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd 1G Sep 28 18:18:07 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:07 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd 1G" returned: 0 in 0.595s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:07 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd Sep 28 18:18:07 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:08 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" returned: 0 in 0.475s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:08 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd is being set with open permissions: ugo+rw Sep 28 18:18:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:08 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd Sep 28 18:18:08 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:08 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" returned: 0 in 0.430s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:08 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.info Sep 28 18:18:08 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:09 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.info" returned: 0 in 0.385s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:09 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.info is being set with open permissions: ugo+rw Sep 28 18:18:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:09 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.info Sep 28 18:18:09 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:09 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.info" returned: 0 in 0.359s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.140s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-92104217-1d46-4881-8933-014470f0da7b tempest-VolumesSnapshotListTestJSON-1136430222 None] Create snapshot completed successfully Sep 28 18:18:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Creating offline snapshot d4fc5be0-51c1-44c8-ad63-9e39b6745639 of volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:18:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[47060982-4b57-4795-aff6-306c3f3e78ef]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:11 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd Sep 28 18:18:11 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:12 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" returned: 0 in 0.754s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:12 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 1G Sep 28 18:18:12 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:12 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 1G" returned: 0 in 0.678s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:12 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 Sep 28 18:18:12 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Flow 'volume_create_manager' (c3ee6acc-b9c9-4375-9c6d-1a91831c3a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8febbda-8a76-4f7b-8001-46bac835ad74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8febbda-8a76-4f7b-8001-46bac835ad74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-391007167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256febdf-e3f0-4206-b1db-36bc0d91255a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e346b0745e7242229e8a0d8d39803ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:13Z,use_quota=True,user_id='c736a2bd83b846ce9cf3d82c04677b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c940f7a5-2d1f-488b-b44e-a90cbf972eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c940f7a5-2d1f-488b-b44e-a90cbf972eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9b136c-e61e-4345-a92d-bfbcffbca938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9b136c-e61e-4345-a92d-bfbcffbca938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256febdf-e3f0-4206-b1db-36bc0d91255a', 'volume_name': 'volume-256febdf-e3f0-4206-b1db-36bc0d91255a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f93cd8-b343-409c-ade5-918e11d18a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f93cd8-b343-409c-ade5-918e11d18a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecee113f-797b-48c5-a7a5-a21fcc92d560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Volume 256febdf-e3f0-4206-b1db-36bc0d91255a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256febdf-e3f0-4206-b1db-36bc0d91255a', 'volume_size': 1} Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:13 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639" returned: 0 in 0.791s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:13 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 is being set with open permissions: ugo+rw Sep 28 18:18:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:13 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 Sep 28 18:18:13 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639" returned: 0 in 0.384s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-391007167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256febdf-e3f0-4206-b1db-36bc0d91255a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e346b0745e7242229e8a0d8d39803ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:13Z,use_quota=True,user_id='c736a2bd83b846ce9cf3d82c04677b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Creating volume 256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:14 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:18:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:14 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a 1073741824 Sep 28 18:18:14 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a6fce785-9135-4841-a744-5d806190bf65 tempest-VolumesSnapshotListTestJSON-1136430222 None] Create snapshot completed successfully Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:15 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a 1073741824" returned: 0 in 1.149s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:15 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a Sep 28 18:18:15 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:15 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a" returned: 0 in 0.412s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.660s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecee113f-797b-48c5-a7a5-a21fcc92d560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256febdf-e3f0-4206-b1db-36bc0d91255a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405f14f3-25c8-4b2c-994e-abe959df7803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Creating offline snapshot 60cc86c3-d416-4f68-a804-18fab6f59fc2 of volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:18:15 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Volume volume-256febdf-e3f0-4206-b1db-36bc0d91255a (256febdf-e3f0-4206-b1db-36bc0d91255a): created successfully Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405f14f3-25c8-4b2c-994e-abe959df7803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Flow 'volume_create_manager' (c3ee6acc-b9c9-4375-9c6d-1a91831c3a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac54d34-7511-4227-ab0f-c38b9a8cb5cb]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-86bb9de0-e8a3-4cf6-9e37-eb41c0d2efe8 req-5b02a65a-50f7-460b-8e95-ff837f0d4655 tempest-VolumesSnapshotsTestJSON-1420215151 None] Created volume successfully. Sep 28 18:18:16 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 Sep 28 18:18:16 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:16 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639" returned: 0 in 0.499s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:16 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 1G Sep 28 18:18:16 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:17 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 1G" returned: 0 in 0.679s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:17 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 Sep 28 18:18:17 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:17 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2" returned: 0 in 0.421s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:17 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 is being set with open permissions: ugo+rw Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:17 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 Sep 28 18:18:17 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:17 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2" returned: 0 in 0.324s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.430s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Creating offline snapshot 04845d44-ef45-4a20-bfb0-7190a73edb48 of volume 256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:18:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d5522d29-13a9-464d-966f-726498538d57 tempest-VolumesSnapshotListTestJSON-1136430222 None] Create snapshot completed successfully Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[996dd8f3-af96-4261-9874-c4e667c9ac0f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:18 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a Sep 28 18:18:18 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:18 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a" returned: 0 in 0.668s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:18 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 1G Sep 28 18:18:18 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:19 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 1G" returned: 0 in 0.738s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256febdf-e3f0-4206-b1db-36bc0d91255a -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:19 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256febdf-e3f0-4206-b1db-36bc0d91255a -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 Sep 28 18:18:19 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:19 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256febdf-e3f0-4206-b1db-36bc0d91255a -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48" returned: 0 in 0.542s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:19 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 is being set with open permissions: ugo+rw Sep 28 18:18:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:19 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 Sep 28 18:18:19 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-60cc86c3-d416-4f68-a804-18fab6f59fc2-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-60cc86c3-d416-4f68-a804-18fab6f59fc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-quobyte-60cc86c3-d416-4f68-a804-18fab6f59fc2" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-60cc86c3-d416-4f68-a804-18fab6f59fc2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Deleting offline snapshot 60cc86c3-d416-4f68-a804-18fab6f59fc2 of volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] snapshot_file for this snap is: volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb88c98e-c68d-478c-952e-749c24ccde31]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:20 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48" returned: 0 in 0.399s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:20 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 Sep 28 18:18:20 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:20 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.info Sep 28 18:18:20 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:20 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.info" returned: 0 in 0.584s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:20 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.info is being set with open permissions: ugo+rw Sep 28 18:18:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:21 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2" returned: 0 in 0.803s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:21 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.info Sep 28 18:18:21 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b7a4ee-039f-4906-b909-9eccca28fb55]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:21 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 Sep 28 18:18:21 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:21 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.info" returned: 0 in 0.469s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.593s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-5afbfac1-e7ec-4ef3-8be4-908f39f9716b req-76402114-e24f-4b80-b999-96ea2fea79d8 tempest-VolumesSnapshotsTestJSON-1420215151 None] Create snapshot completed successfully Sep 28 18:18:21 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639" returned: 0 in 0.659s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:21 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 Sep 28 18:18:21 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:22 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2" returned: 0 in 0.984s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:22 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2 Sep 28 18:18:22 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "cinder-04845d44-ef45-4a20-bfb0-7190a73edb48-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-04845d44-ef45-4a20-bfb0-7190a73edb48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:23 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "cinder-quobyte-256febdf-e3f0-4206-b1db-36bc0d91255a" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.60cc86c3-d416-4f68-a804-18fab6f59fc2" returned: 0 in 0.476s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-60cc86c3-d416-4f68-a804-18fab6f59fc2" released by "_delete_snapshot" :: held 3.167s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-quobyte-256febdf-e3f0-4206-b1db-36bc0d91255a" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "cinder-quobyte-04845d44-ef45-4a20-bfb0-7190a73edb48" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" released by "delete_snapshot" :: held 3.206s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-quobyte-04845d44-ef45-4a20-bfb0-7190a73edb48" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Deleting offline snapshot 04845d44-ef45-4a20-bfb0-7190a73edb48 of volume 256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] snapshot_file for this snap is: volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad39ea6-391e-47f7-82b1-e4ad2cbea04f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Created reservations ['9646e025-29b1-449f-9cc5-275f2784fd02', '2fac43bd-2316-4ff8-be2b-6ba5be75bc7e', '9c38fea8-0a76-4812-8dc8-8d349090fe89', '7848e151-2896-45e6-adeb-06325647802d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Delete snapshot completed successfully. Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-17e684e7-4f8d-45eb-ab3a-b1cdb9d424d0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-60cc86c3-d416-4f68-a804-18fab6f59fc2-delete_snapshot" released by "delete_snapshot" :: held 3.482s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:23 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 Sep 28 18:18:23 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:23 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48" returned: 0 in 0.504s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256febdf-e3f0-4206-b1db-36bc0d91255a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2567952b-aac9-4b47-a13e-068e7afcc9b3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:24 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a Sep 28 18:18:24 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-d4fc5be0-51c1-44c8-ad63-9e39b6745639-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-d4fc5be0-51c1-44c8-ad63-9e39b6745639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-quobyte-d4fc5be0-51c1-44c8-ad63-9e39b6745639" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-d4fc5be0-51c1-44c8-ad63-9e39b6745639" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Deleting offline snapshot d4fc5be0-51c1-44c8-ad63-9e39b6745639 of volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] snapshot_file for this snap is: volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:18:24 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a" returned: 0 in 0.876s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b956a-c511-4101-9b40-d5de6a59ca52]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:24 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 Sep 28 18:18:24 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:25 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 Sep 28 18:18:25 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:25 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48" returned: 0 in 0.740s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:25 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48 Sep 28 18:18:25 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:25 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639" returned: 0 in 0.785s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac01276-6f5a-4d33-b75e-7ca857f94a77]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:25 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd Sep 28 18:18:25 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:26 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a.04845d44-ef45-4a20-bfb0-7190a73edb48" returned: 0 in 0.909s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-quobyte-04845d44-ef45-4a20-bfb0-7190a73edb48" released by "_delete_snapshot" :: held 3.289s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-quobyte-256febdf-e3f0-4206-b1db-36bc0d91255a" released by "delete_snapshot" :: held 3.360s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:26 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" returned: 0 in 1.040s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:26 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 Sep 28 18:18:26 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:27 devstack cinder-volume[86981]: DEBUG cinder.quota [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Created reservations ['02551bd3-94f6-4cbe-ae00-5f0010627430', '158252ff-0e1c-4802-8c2d-746682117fec', '2c386171-4109-488c-9cb0-60af4455dd93', '416f6480-aa4b-4c85-ad96-61e861ae0e23'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Delete snapshot completed successfully. Sep 28 18:18:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-58774714-8b17-461a-b5d0-608120fffac7 req-f856eafb-3633-448a-9eb1-a4a789cde1a5 tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-04845d44-ef45-4a20-bfb0-7190a73edb48-delete_snapshot" released by "delete_snapshot" :: held 4.050s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:27 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639" returned: 0 in 0.986s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:27 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639 Sep 28 18:18:27 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:28 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.d4fc5be0-51c1-44c8-ad63-9e39b6745639" returned: 0 in 0.579s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "cinder-256febdf-e3f0-4206-b1db-36bc0d91255a-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-d4fc5be0-51c1-44c8-ad63-9e39b6745639" released by "_delete_snapshot" :: held 3.753s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" released by "delete_snapshot" :: held 3.830s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-256febdf-e3f0-4206-b1db-36bc0d91255a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "cinder-quobyte-256febdf-e3f0-4206-b1db-36bc0d91255a" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-quobyte-256febdf-e3f0-4206-b1db-36bc0d91255a" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa46d27-7abc-4d28-9251-1bd86e0af989]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Created reservations ['d2ec3a05-3e3b-4df7-addf-f6514f6929fb', '0f0ba691-a68d-4d87-a21a-64204d43539e', 'aab6ecea-d9d9-4f08-ab95-762159fd1993', '8c2976fb-1de3-47d3-b23f-5e9cb9ed310b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Delete snapshot completed successfully. Sep 28 18:18:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6eb58b7b-1dcb-493a-88e1-6fe5af4d25fc tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-d4fc5be0-51c1-44c8-ad63-9e39b6745639-delete_snapshot" released by "delete_snapshot" :: held 4.184s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:28 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a Sep 28 18:18:28 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-quobyte-973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Deleting offline snapshot 973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd of volume bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] snapshot_file for this snap is: volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116d5bb-464c-43af-832d-8e9f4d55aa38]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:29 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a" returned: 0 in 0.559s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:29 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a Sep 28 18:18:29 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:29 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd Sep 28 18:18:29 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:29 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-256febdf-e3f0-4206-b1db-36bc0d91255a" returned: 0 in 0.533s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-quobyte-256febdf-e3f0-4206-b1db-36bc0d91255a" released by "delete_volume" :: held 1.217s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG cinder.quota [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Created reservations ['2aa3a62f-8d55-4f0d-a835-51e7cc10b6ba', 'b88eafcd-2da2-4da1-a503-54d655d18d5c', '32b4bf08-b8c9-4d13-9bdf-20c7fd3e6793', '0b3f62cf-9a27-4433-bfd8-4dfdb7c96872'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:30 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" returned: 0 in 1.134s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:30 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:18:30 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[77508971-1bb3-4d40-9559-13cf2321c7b6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:30 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 Sep 28 18:18:30 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:30 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.597s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:30 devstack cinder-volume[86981]: DEBUG cinder.manager [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Deleted volume successfully. Sep 28 18:18:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-555f9c5e-ba21-4fb5-9131-5208fe666946 req-99136a8c-e410-4fb4-80c2-f6132992d07a tempest-VolumesSnapshotsTestJSON-1420215151 None] Lock "cinder-256febdf-e3f0-4206-b1db-36bc0d91255a-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:31 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" returned: 0 in 0.985s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:31 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd Sep 28 18:18:31 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:32 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" returned: 0 in 0.885s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:32 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd Sep 28 18:18:32 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:32 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18.973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" returned: 0 in 0.543s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd" released by "_delete_snapshot" :: held 3.812s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" released by "delete_snapshot" :: held 3.857s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:33 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Created reservations ['c820f706-5687-4b93-8e01-888ddc4930db', 'ff165f53-5bd3-451f-a5fa-0f133e420bc5', 'b0588774-dc76-4daa-a280-9b349120215e', '856fead3-92cd-4836-a86d-92985b787274'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Delete snapshot completed successfully. Sep 28 18:18:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4c971058-2d9d-4644-be43-4c6b5bda9ce0 tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-973a9ea4-1cc2-4c6d-ad2e-bfe8eab8a0dd-delete_snapshot" released by "delete_snapshot" :: held 4.401s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-bbfc50fc-8c7e-4460-a9c4-0bc561776d18-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-bbfc50fc-8c7e-4460-a9c4-0bc561776d18-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" acquired by "delete_volume" :: waited 0.053s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c57dd-4e3f-4f3c-9e41-5ecccd19c6c5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:34 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 Sep 28 18:18:34 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:35 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" returned: 0 in 0.931s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:35 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18 Sep 28 18:18:35 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:35 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" returned: 0 in 0.466s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-quobyte-bbfc50fc-8c7e-4460-a9c4-0bc561776d18" released by "delete_volume" :: held 1.521s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Created reservations ['b149247f-5ba7-4f07-bf9f-f0ea8482c5ae', '2234349b-9e57-4317-8d04-32291b037291', '2d74d8bd-32ec-49c4-93cb-6a16fb18927f', 'ac79d850-3994-4ec4-8a9d-0c7540a4bfcd'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:36 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:18:36 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:36 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.677s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:36 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:36 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Deleted volume successfully. Sep 28 18:18:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-95a79641-63f7-4f7e-9cb9-7213adabc9ca tempest-VolumesSnapshotListTestJSON-1136430222 None] Lock "cinder-bbfc50fc-8c7e-4460-a9c4-0bc561776d18-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:38 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:18:38 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:39 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.336s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:18:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Flow 'volume_create_manager' (3f12743b-94c9-497b-90b3-2a6a263484bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83f8841-d92c-423e-a7bc-2b3599c16d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83f8841-d92c-423e-a7bc-2b3599c16d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1024882918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6b0dde-4cc3-454a-a462-7f9089efb5b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d30e1eec1478582040a712a554f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:41Z,use_quota=True,user_id='c672f9b7f5cf42f19ef99ff0162ec6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be8fa0e-8aaf-462b-b9f8-a394dec616b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be8fa0e-8aaf-462b-b9f8-a394dec616b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c7025a-e1f7-45de-813e-bd5d502c14d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c7025a-e1f7-45de-813e-bd5d502c14d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6b0dde-4cc3-454a-a462-7f9089efb5b4', 'volume_name': 'volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b9ab93-325c-4def-871e-17de54e70f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b9ab93-325c-4def-871e-17de54e70f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f35312b-05cf-438b-ae8a-f383a34cdc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:41 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Volume ae6b0dde-4cc3-454a-a462-7f9089efb5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4', 'volume_size': 1} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1024882918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6b0dde-4cc3-454a-a462-7f9089efb5b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d30e1eec1478582040a712a554f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:41Z,use_quota=True,user_id='c672f9b7f5cf42f19ef99ff0162ec6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Creating volume ae6b0dde-4cc3-454a-a462-7f9089efb5b4 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:41 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:41 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 1073741824 Sep 28 18:18:41 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:41 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 1073741824" returned: 0 in 0.721s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:42 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 Sep 28 18:18:42 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:42 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4" returned: 0 in 0.316s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f35312b-05cf-438b-ae8a-f383a34cdc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078f86a5-65ab-45fa-9862-55cebf628b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:42 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Volume volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 (ae6b0dde-4cc3-454a-a462-7f9089efb5b4): created successfully Sep 28 18:18:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078f86a5-65ab-45fa-9862-55cebf628b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Flow 'volume_create_manager' (3f12743b-94c9-497b-90b3-2a6a263484bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-71dcb7d1-e719-4801-b8f1-bfbfcd072c6b tempest-VolumesTestJSON-695971294 None] Created volume successfully. Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Flow 'volume_create_manager' (952ef7e8-1ead-449a-bef5-c470b07b92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de108a6-5a07-4b07-b04d-d4d5d977df00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de108a6-5a07-4b07-b04d-d4d5d977df00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-459811605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670aa94f-a86c-421c-a7ba-59432daae6a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d30e1eec1478582040a712a554f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:44Z,use_quota=True,user_id='c672f9b7f5cf42f19ef99ff0162ec6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bad906b-7687-4878-b8b9-3f1a3b24a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bad906b-7687-4878-b8b9-3f1a3b24a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea19177-660f-4aef-941d-cda8403824f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea19177-660f-4aef-941d-cda8403824f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670aa94f-a86c-421c-a7ba-59432daae6a7', 'volume_name': 'volume-670aa94f-a86c-421c-a7ba-59432daae6a7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21b107b-d965-4f5b-b141-88000361f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21b107b-d965-4f5b-b141-88000361f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72951ca8-88e7-40d8-9006-71d0f70851c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:44 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Volume 670aa94f-a86c-421c-a7ba-59432daae6a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670aa94f-a86c-421c-a7ba-59432daae6a7', 'volume_size': 1} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-459811605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670aa94f-a86c-421c-a7ba-59432daae6a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d30e1eec1478582040a712a554f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:44Z,use_quota=True,user_id='c672f9b7f5cf42f19ef99ff0162ec6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Creating volume 670aa94f-a86c-421c-a7ba-59432daae6a7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:44 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:44 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 1073741824 Sep 28 18:18:44 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:44 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 1073741824" returned: 0 in 0.605s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:44 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 Sep 28 18:18:44 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:45 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7" returned: 0 in 0.396s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72951ca8-88e7-40d8-9006-71d0f70851c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670aa94f-a86c-421c-a7ba-59432daae6a7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39d8c5c-279f-4619-a639-edde216bc378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Volume volume-670aa94f-a86c-421c-a7ba-59432daae6a7 (670aa94f-a86c-421c-a7ba-59432daae6a7): created successfully Sep 28 18:18:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39d8c5c-279f-4619-a639-edde216bc378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Flow 'volume_create_manager' (952ef7e8-1ead-449a-bef5-c470b07b92d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:45 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9d1d7b22-58df-4ada-8223-37269d7180ff tempest-VolumesTestJSON-695971294 None] Created volume successfully. Sep 28 18:18:46 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Flow 'volume_create_manager' (08b41085-9ec1-475b-a16c-5e8732b96bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab06a407-9ed2-4e6c-a0d0-e21e64b64624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab06a407-9ed2-4e6c-a0d0-e21e64b64624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1083000221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dfe8a5-7487-4acc-a961-f58dec705348,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d30e1eec1478582040a712a554f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='c672f9b7f5cf42f19ef99ff0162ec6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7247cf1d-cdf3-4508-bd8a-788978aa9424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7247cf1d-cdf3-4508-bd8a-788978aa9424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d27ce-1776-4904-9c50-7a81a0ceb2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d27ce-1776-4904-9c50-7a81a0ceb2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21dfe8a5-7487-4acc-a961-f58dec705348', 'volume_name': 'volume-21dfe8a5-7487-4acc-a961-f58dec705348', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cac8f5-698b-460a-9245-82055434876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cac8f5-698b-460a-9245-82055434876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b00735-0094-4fcd-a129-7a4889554180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Volume 21dfe8a5-7487-4acc-a961-f58dec705348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21dfe8a5-7487-4acc-a961-f58dec705348', 'volume_size': 1} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1083000221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dfe8a5-7487-4acc-a961-f58dec705348,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d30e1eec1478582040a712a554f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='c672f9b7f5cf42f19ef99ff0162ec6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Creating volume 21dfe8a5-7487-4acc-a961-f58dec705348 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:47 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 1073741824 Sep 28 18:18:47 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Flow 'volume_create_manager' (fa9cbf7a-6165-4f70-bf0a-c17c3c5df10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d7f30f-81d8-45c3-983f-b6796c8476ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d7f30f-81d8-45c3-983f-b6796c8476ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cf86af-08bc-4229-83c6-e6a5d8196336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77800e00d3c4771b70b194749bb3303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='2abd9ae15f6d4de990c831544a51aa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f17cc82b-4be8-4302-b066-8d70c00751b3),volume_type_id=f17cc82b-4be8-4302-b066-8d70c00751b3)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cdaf3b-8fe7-4722-ac08-781c8e410bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cdaf3b-8fe7-4722-ac08-781c8e410bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4c6ed-8a79-453b-9330-67a569dfd033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4c6ed-8a79-453b-9330-67a569dfd033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6cf86af-08bc-4229-83c6-e6a5d8196336', 'volume_name': 'volume-a6cf86af-08bc-4229-83c6-e6a5d8196336', 'volume_size': 1, 'image_id': 'a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be713d41d731a2d4ea85694b7aa7d9ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c77800e00d3c4771b70b194749bb3303', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '07512983cb5a6a319ddd76bc2bf32284e07d1252d71dedc9fdfe918f60292d9f295e0a32c29ee665937cfd6f611803c0ab67318d512613015d534f73ddf040f3', 'id': 'a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'created_at': datetime.datetime(2026, 9, 28, 16, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b87e0f1-606c-4215-9b69-b9d5ab13c98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b87e0f1-606c-4215-9b69-b9d5ab13c98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6543a889-f56b-4baa-82f2-48c956cd49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Volume a6cf86af-08bc-4229-83c6-e6a5d8196336: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6cf86af-08bc-4229-83c6-e6a5d8196336', 'volume_size': 1, 'image_id': 'a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be713d41d731a2d4ea85694b7aa7d9ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c77800e00d3c4771b70b194749bb3303', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '07512983cb5a6a319ddd76bc2bf32284e07d1252d71dedc9fdfe918f60292d9f295e0a32c29ee665937cfd6f611803c0ab67318d512613015d534f73ddf040f3', 'id': 'a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'created_at': datetime.datetime(2026, 9, 28, 16, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Trying to clone a6cf86af-08bc-4229-83c6-e6a5d8196336 from image a832c497-e2a0-4d4a-89fe-9b2d844eb804 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:18:47 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 1073741824" returned: 0 in 0.587s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 Sep 28 18:18:47 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:18:47 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[459a740d-b813-4f0a-b2c6-2cb4f89c68b1]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD Sep 28 18:18:47 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b00735-0094-4fcd-a129-7a4889554180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21dfe8a5-7487-4acc-a961-f58dec705348', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c74676-6246-4027-add5-e789ef5ff58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:48 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Volume volume-21dfe8a5-7487-4acc-a961-f58dec705348 (21dfe8a5-7487-4acc-a961-f58dec705348): created successfully Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c74676-6246-4027-add5-e789ef5ff58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Flow 'volume_create_manager' (08b41085-9ec1-475b-a16c-5e8732b96bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-49c07931-260f-4c2d-bd5e-9154220b79c7 tempest-VolumesTestJSON-695971294 None] Created volume successfully. Sep 28 18:18:48 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:48 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD Sep 28 18:18:48 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Temporary image a832c497-e2a0-4d4a-89fe-9b2d844eb804 is fetched for user 2abd9ae15f6d4de990c831544a51aa99. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925ca68-408a-45b9-88a0-18c0ed2806c3]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:48 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD Sep 28 18:18:48 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:49 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD Sep 28 18:18:49 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:49 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD" returned: 1 in 0.394s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cf86af-08bc-4229-83c6-e6a5d8196336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77800e00d3c4771b70b194749bb3303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:47Z,use_quota=True,user_id='2abd9ae15f6d4de990c831544a51aa99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f17cc82b-4be8-4302-b066-8d70c00751b3),volume_type_id=f17cc82b-4be8-4302-b066-8d70c00751b3)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Creating volume a6cf86af-08bc-4229-83c6-e6a5d8196336 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:49 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:49 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 1073741824 Sep 28 18:18:49 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:49 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 1073741824" returned: 0 in 0.519s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:49 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 Sep 28 18:18:49 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Acquiring lock "cinder-21dfe8a5-7487-4acc-a961-f58dec705348-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Lock "cinder-21dfe8a5-7487-4acc-a961-f58dec705348-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Acquiring lock "cinder-quobyte-21dfe8a5-7487-4acc-a961-f58dec705348" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Lock "cinder-quobyte-21dfe8a5-7487-4acc-a961-f58dec705348" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1487ee50-b1b2-448f-82a8-f9a563a7e44e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 Sep 28 18:18:50 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336" returned: 0 in 0.283s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Attempting download of a832c497-e2a0-4d4a-89fe-9b2d844eb804 ((None, [{'url': 'file:///opt/stack/data/glance/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'metadata': {}}])) to volume a6cf86af-08bc-4229-83c6-e6a5d8196336. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dcd07-a050-4521-abc7-a46229d390f4]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a832c497-e2a0-4d4a-89fe-9b2d844eb804_tv74o782 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a832c497-e2a0-4d4a-89fe-9b2d844eb804_tv74o782 Sep 28 18:18:50 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348" returned: 0 in 0.384s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348 Sep 28 18:18:50 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a832c497-e2a0-4d4a-89fe-9b2d844eb804_tv74o782" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a832c497-e2a0-4d4a-89fe-9b2d844eb804_tv74o782 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-21dfe8a5-7487-4acc-a961-f58dec705348" returned: 0 in 0.266s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Lock "cinder-quobyte-21dfe8a5-7487-4acc-a961-f58dec705348" released by "delete_volume" :: held 0.711s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:50 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a832c497-e2a0-4d4a-89fe-9b2d844eb804_tv74o782 Sep 28 18:18:50 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Created reservations ['3bef479f-ecc1-4def-a2d9-8dc16dbbb96f', 'd28ea645-2f54-49d3-a2a1-7460e051adf6', 'b7828b31-0d00-40a3-9f19-23737c455435', '3437d664-81a8-42dd-ba19-4a57be1d49c0'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:50 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:18:50 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a832c497-e2a0-4d4a-89fe-9b2d844eb804_tv74o782" returned: 1 in 0.375s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a832c497-e2a0-4d4a-89fe-9b2d844eb804_tv74o782' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8917fd6-75fb-4834-8d03-c70a8867d59d]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD Sep 28 18:18:51 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Acquiring lock "cinder-670aa94f-a86c-421c-a7ba-59432daae6a7-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Lock "cinder-670aa94f-a86c-421c-a7ba-59432daae6a7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:51 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.340s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Acquiring lock "cinder-quobyte-670aa94f-a86c-421c-a7ba-59432daae6a7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Deleted volume successfully. Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Lock "cinder-quobyte-670aa94f-a86c-421c-a7ba-59432daae6a7" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-70d0199c-12d4-490f-8ec6-84b2551739b4 tempest-VolumesTestJSON-695971294 None] Lock "cinder-21dfe8a5-7487-4acc-a961-f58dec705348-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acf6c33-ad96-48ee-bfca-a9efcd99f579]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 Sep 28 18:18:51 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD Sep 28 18:18:51 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7" returned: 0 in 0.454s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7 Sep 28 18:18:51 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:51 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] a832c497-e2a0-4d4a-89fe-9b2d844eb804 was raw, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:18:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:51 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 Sep 28 18:18:51 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-670aa94f-a86c-421c-a7ba-59432daae6a7" returned: 0 in 0.311s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Lock "cinder-quobyte-670aa94f-a86c-421c-a7ba-59432daae6a7" released by "delete_volume" :: held 0.815s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Created reservations ['7ef5c649-8fbe-4a75-90aa-69d3c3df7d62', 'fcb4880a-c15d-4396-9387-8c859a8e1d21', '1483811a-fb42-4d0c-80b8-9392bb694f47', '75dd1ab9-8b60-4f7d-a439-efdfa2e631fd'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:52 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:18:52 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Acquiring lock "cinder-ae6b0dde-4cc3-454a-a462-7f9089efb5b4-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Lock "cinder-ae6b0dde-4cc3-454a-a462-7f9089efb5b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:52 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336" returned: 0 in 0.664s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a832c497-e2a0-4d4a-89fe-9b2d844eb804_j8kydce1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:18:52 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:52 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 1G Sep 28 18:18:52 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Acquiring lock "cinder-quobyte-ae6b0dde-4cc3-454a-a462-7f9089efb5b4" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Lock "cinder-quobyte-ae6b0dde-4cc3-454a-a462-7f9089efb5b4" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[14204350-e221-4f6c-a259-89dda232f75b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:52 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.376s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Deleted volume successfully. Sep 28 18:18:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-90f9875b-240b-4384-9be7-7f6d73ab53db tempest-VolumesTestJSON-695971294 None] Lock "cinder-670aa94f-a86c-421c-a7ba-59432daae6a7-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:52 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 Sep 28 18:18:52 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:53 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 1G" returned: 0 in 0.460s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Downloaded image a832c497-e2a0-4d4a-89fe-9b2d844eb804 ((None, [{'url': 'file:///opt/stack/data/glance/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'metadata': {}}])) to volume a6cf86af-08bc-4229-83c6-e6a5d8196336 successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Temporary image a832c497-e2a0-4d4a-89fe-9b2d844eb804 for user 2abd9ae15f6d4de990c831544a51aa99 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Marking volume a6cf86af-08bc-4229-83c6-e6a5d8196336 as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Copying metadata from image a832c497-e2a0-4d4a-89fe-9b2d844eb804 to a6cf86af-08bc-4229-83c6-e6a5d8196336. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Creating volume glance metadata for volume a6cf86af-08bc-4229-83c6-e6a5d8196336 backed by image a832c497-e2a0-4d4a-89fe-9b2d844eb804 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'be713d41d731a2d4ea85694b7aa7d9ce', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6543a889-f56b-4baa-82f2-48c956cd49cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cf86af-08bc-4229-83c6-e6a5d8196336', 'volume_size': 1, 'image_id': 'a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be713d41d731a2d4ea85694b7aa7d9ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c77800e00d3c4771b70b194749bb3303', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '07512983cb5a6a319ddd76bc2bf32284e07d1252d71dedc9fdfe918f60292d9f295e0a32c29ee665937cfd6f611803c0ab67318d512613015d534f73ddf040f3', 'id': 'a832c497-e2a0-4d4a-89fe-9b2d844eb804', 'created_at': datetime.datetime(2026, 9, 28, 16, 18, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 18, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a832c497-e2a0-4d4a-89fe-9b2d844eb804/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412bfdd3-c654-4c8e-bf67-e4451373f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:53 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Volume volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 (a6cf86af-08bc-4229-83c6-e6a5d8196336): created successfully Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412bfdd3-c654-4c8e-bf67-e4451373f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Flow 'volume_create_manager' (fa9cbf7a-6165-4f70-bf0a-c17c3c5df10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-97e5705e-fb5c-44f7-932b-8034b59a4672 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Created volume successfully. Sep 28 18:18:53 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4" returned: 0 in 0.511s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:53 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4 Sep 28 18:18:53 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:53 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae6b0dde-4cc3-454a-a462-7f9089efb5b4" returned: 0 in 0.271s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Lock "cinder-quobyte-ae6b0dde-4cc3-454a-a462-7f9089efb5b4" released by "delete_volume" :: held 0.840s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Created reservations ['98df0c20-ceee-4a68-ac61-65a303e3c1b5', '281ec8c0-6651-4b91-b2b9-e78f81a3cd00', 'b958def7-a16b-4cfd-9a06-91adc2038738', '47f5469b-c42c-4da0-b5e7-607f536c971b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:53 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:18:53 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Acquiring lock "cinder-a6cf86af-08bc-4229-83c6-e6a5d8196336-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "cinder-a6cf86af-08bc-4229-83c6-e6a5d8196336-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Acquiring lock "cinder-quobyte-a6cf86af-08bc-4229-83c6-e6a5d8196336" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "cinder-quobyte-a6cf86af-08bc-4229-83c6-e6a5d8196336" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12caf8a-bf90-4f49-b29e-d40db71d3e08]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:54 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Deleted volume successfully. Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=99,cinder:UPDATE=96,cinder:INSERT=25,cinder:DELETE=12 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06fc69a2-7593-4e52-bba1-14bff548d9ea tempest-VolumesTestJSON-695971294 None] Lock "cinder-ae6b0dde-4cc3-454a-a462-7f9089efb5b4-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:54 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 Sep 28 18:18:54 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:54 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336" returned: 0 in 0.440s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:54 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336 Sep 28 18:18:54 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:54 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a6cf86af-08bc-4229-83c6-e6a5d8196336" returned: 0 in 0.302s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "cinder-quobyte-a6cf86af-08bc-4229-83c6-e6a5d8196336" released by "delete_volume" :: held 0.813s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=91,cinder:INSERT=34,cinder:UPDATE=105,cinder:DELETE=5 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:54 devstack cinder-volume[86981]: WARNING cinder.quota [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:18:54 devstack cinder-volume[86981]: WARNING cinder.quota [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Created reservations ['f569ffec-6a3a-4637-9657-0e2632904bcf', '45541349-d285-43fc-bca0-6b22134d6217', 'afbafc43-9d43-46bf-be7a-2e99c7b88c31', '72523635-aaca-4a26-86af-742ea3433884'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:55 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:18:55 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:55 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.404s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:55 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Deleted volume successfully. Sep 28 18:18:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-975c62b5-2230-459b-b4ca-d53d4562c3b5 tempest-VolumeAndVolumeTypeFromImageTest-847069323 None] Lock "cinder-a6cf86af-08bc-4229-83c6-e6a5d8196336-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Flow 'volume_create_manager' (a89124d0-a6fd-4040-9980-7092166f1745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd401346-f478-4108-a33f-ac0aa51edf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd401346-f478-4108-a33f-ac0aa51edf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-311647740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6ce344-febf-4e80-a800-d81b7e12d55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ddf0875d49a891783726de97cd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:56Z,use_quota=True,user_id='97e823bf24654bfc97c5f98441798824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6127cd80-2257-442c-94f7-65a294e5e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6127cd80-2257-442c-94f7-65a294e5e42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3286b640-35e0-4c08-80f3-e70188af66d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3286b640-35e0-4c08-80f3-e70188af66d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6ce344-febf-4e80-a800-d81b7e12d55f', 'volume_name': 'volume-ac6ce344-febf-4e80-a800-d81b7e12d55f', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770120a9-4747-41c3-8040-ae64ab0a12fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770120a9-4747-41c3-8040-ae64ab0a12fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecea97cf-39d7-454c-a5e2-eaddb6580547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:56 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Volume ac6ce344-febf-4e80-a800-d81b7e12d55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6ce344-febf-4e80-a800-d81b7e12d55f', 'volume_size': 1} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-311647740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6ce344-febf-4e80-a800-d81b7e12d55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ddf0875d49a891783726de97cd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:56Z,use_quota=True,user_id='97e823bf24654bfc97c5f98441798824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Creating volume ac6ce344-febf-4e80-a800-d81b7e12d55f {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:56 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:56 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f 1073741824 Sep 28 18:18:56 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:56 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f 1073741824" returned: 0 in 0.608s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:56 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f Sep 28 18:18:56 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:57 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f" returned: 0 in 0.396s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecea97cf-39d7-454c-a5e2-eaddb6580547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6ce344-febf-4e80-a800-d81b7e12d55f', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d071dc1-3033-44ff-bdb1-0b89128c8666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Volume volume-ac6ce344-febf-4e80-a800-d81b7e12d55f (ac6ce344-febf-4e80-a800-d81b7e12d55f): created successfully Sep 28 18:18:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d071dc1-3033-44ff-bdb1-0b89128c8666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Flow 'volume_create_manager' (a89124d0-a6fd-4040-9980-7092166f1745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:57 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-af9b97c5-1e5d-4a3b-b985-165539a853a1 tempest-AttachVolumeNegativeTest-1997790671 None] Created volume successfully. Sep 28 18:18:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-247e590f-b817-44f9-adff-fa59dcb1dc36 req-7b8c6642-a033-41f2-b6bb-c9624d8e885b tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-247e590f-b817-44f9-adff-fa59dcb1dc36 req-7b8c6642-a033-41f2-b6bb-c9624d8e885b tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-247e590f-b817-44f9-adff-fa59dcb1dc36 req-7b8c6642-a033-41f2-b6bb-c9624d8e885b tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-247e590f-b817-44f9-adff-fa59dcb1dc36 req-7b8c6642-a033-41f2-b6bb-c9624d8e885b tempest-AttachVolumeNegativeTest-1997790671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-ac6ce344-febf-4e80-a800-d81b7e12d55f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '865c8733-eb87-45c0-904a-3801330f3298', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:18:59 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-247e590f-b817-44f9-adff-fa59dcb1dc36 req-7b8c6642-a033-41f2-b6bb-c9624d8e885b tempest-AttachVolumeNegativeTest-1997790671 None] attachment_update completed successfully. Sep 28 18:19:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f37dbe59-ed16-4c5b-9010-5c99910236b6 tempest-GroupsTest-1563497356 None] Group tempest-Group1-1247219914: creating Sep 28 18:19:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f37dbe59-ed16-4c5b-9010-5c99910236b6 tempest-GroupsTest-1563497356 None] Group tempest-Group1-1247219914: created successfully Sep 28 18:19:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f37dbe59-ed16-4c5b-9010-5c99910236b6 tempest-GroupsTest-1563497356 None] Create group completed successfully. Sep 28 18:19:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b871df67-67a2-4292-a31e-508e94004317 tempest-GroupsTest-1563497356 None] Group tempest-Group2-163607729: creating Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (5dd67053-1708-445e-a35f-218f63396513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c56d75-9dac-449b-bb8e-e43f2f6a0632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c56d75-9dac-449b-bb8e-e43f2f6a0632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271332478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6affcd36-8246-4cba-a272-36329fcbe368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:03Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ebe66-b4d8-4d42-8c20-0a05f8a2fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ebe66-b4d8-4d42-8c20-0a05f8a2fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb572788-4d27-4c88-a8eb-e88ebd7dfed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb572788-4d27-4c88-a8eb-e88ebd7dfed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6affcd36-8246-4cba-a272-36329fcbe368', 'volume_name': 'volume-6affcd36-8246-4cba-a272-36329fcbe368', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82be3711-f450-4231-b797-5f532a64e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82be3711-f450-4231-b797-5f532a64e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b58b85-f4a3-4d97-9c53-556f03e2055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Volume 6affcd36-8246-4cba-a272-36329fcbe368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6affcd36-8246-4cba-a272-36329fcbe368', 'volume_size': 1} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271332478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6affcd36-8246-4cba-a272-36329fcbe368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:03Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Creating volume 6affcd36-8246-4cba-a272-36329fcbe368 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:03 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:03 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 1073741824 Sep 28 18:19:03 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b871df67-67a2-4292-a31e-508e94004317 tempest-GroupsTest-1563497356 None] Group tempest-Group2-163607729: created successfully Sep 28 18:19:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-54dfae96-1009-4fb0-b2da-0c298c64d24a req-48c892ed-0b65-43ec-b238-fe79ba565c57 tempest-AttachVolumeNegativeTest-1997790671 None] Terminate volume connection completed successfully. Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-54dfae96-1009-4fb0-b2da-0c298c64d24a req-48c892ed-0b65-43ec-b238-fe79ba565c57 tempest-AttachVolumeNegativeTest-1997790671 None] Deleting attachment 865c8733-eb87-45c0-904a-3801330f3298. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:19:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b871df67-67a2-4292-a31e-508e94004317 tempest-GroupsTest-1563497356 None] Create group completed successfully. Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (7d16aaf8-0d0e-4853-8df3-581a721b79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13471bc1-ae34-4d21-ba7d-5cfb5b6daef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13471bc1-ae34-4d21-ba7d-5cfb5b6daef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1720980751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c380c9c-7869-4d55-977e-18989003dacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:04Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a73b923-d51a-49f6-ba50-06f05ad62eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a73b923-d51a-49f6-ba50-06f05ad62eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580f05a8-168c-4a46-b722-81c8da623362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580f05a8-168c-4a46-b722-81c8da623362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c380c9c-7869-4d55-977e-18989003dacd', 'volume_name': 'volume-0c380c9c-7869-4d55-977e-18989003dacd', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffec456-7c2f-484a-9e7b-b423899e8e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffec456-7c2f-484a-9e7b-b423899e8e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d0a92d-4417-4b1d-82aa-c4aedf1d47ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Volume 0c380c9c-7869-4d55-977e-18989003dacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c380c9c-7869-4d55-977e-18989003dacd', 'volume_size': 1} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (72049308-2fc4-4016-9a9f-a2f81f02b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b514870f-407f-49e6-a7d2-e110bea5978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:04 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b514870f-407f-49e6-a7d2-e110bea5978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261672204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7f7a2a-7905-446b-ac7f-4d734e990855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:04Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe59c1-76ca-4422-949d-d2d486016310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe59c1-76ca-4422-949d-d2d486016310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52644a6-0d82-4b4c-a12e-d365121490b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52644a6-0d82-4b4c-a12e-d365121490b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7f7a2a-7905-446b-ac7f-4d734e990855', 'volume_name': 'volume-ad7f7a2a-7905-446b-ac7f-4d734e990855', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b4dcfd-da31-42f0-96f6-529c107c4977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b4dcfd-da31-42f0-96f6-529c107c4977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd6ffdd-5c1d-4e6f-b0ec-bb907da9a03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Volume ad7f7a2a-7905-446b-ac7f-4d734e990855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7f7a2a-7905-446b-ac7f-4d734e990855', 'volume_size': 1} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 1073741824" returned: 0 in 1.174s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:04 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 Sep 28 18:19:04 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:05 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368" returned: 0 in 0.537s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1720980751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c380c9c-7869-4d55-977e-18989003dacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:04Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Creating volume 0c380c9c-7869-4d55-977e-18989003dacd {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:05 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b58b85-f4a3-4d97-9c53-556f03e2055d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6affcd36-8246-4cba-a272-36329fcbe368', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70225ab-58ed-46d4-87b9-f224f888dc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:05 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd 1073741824 Sep 28 18:19:05 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:05 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Volume volume-6affcd36-8246-4cba-a272-36329fcbe368 (6affcd36-8246-4cba-a272-36329fcbe368): created successfully Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70225ab-58ed-46d4-87b9-f224f888dc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (5dd67053-1708-445e-a35f-218f63396513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:05 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7dc7c0b9-562e-4e2a-abc9-f0112d8d61ef tempest-CreateVolumesFromImageTest-631984083 None] Created volume successfully. Sep 28 18:19:06 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd 1073741824" returned: 0 in 1.143s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (03ef25e4-3020-4bec-ae20-a9ecd31529e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047faf49-4257-442b-b8e0-f59451c8cad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047faf49-4257-442b-b8e0-f59451c8cad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53995261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c829686-4dcc-460b-9fe0-eeedc349bcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:06Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97979451-a888-40b1-a9f7-37917da626a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97979451-a888-40b1-a9f7-37917da626a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd6c183-adb2-4916-8a86-f27273791b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd6c183-adb2-4916-8a86-f27273791b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c829686-4dcc-460b-9fe0-eeedc349bcda', 'volume_name': 'volume-3c829686-4dcc-460b-9fe0-eeedc349bcda', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6566fd5-c2d7-42d0-b181-eac816c365db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6566fd5-c2d7-42d0-b181-eac816c365db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66225a0d-4418-40f1-a2a9-9bb61c0f42b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Volume 3c829686-4dcc-460b-9fe0-eeedc349bcda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c829686-4dcc-460b-9fe0-eeedc349bcda', 'volume_size': 1} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:06 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd Sep 28 18:19:06 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Flow 'volume_create_manager' (d26588fe-5d19-4e71-8b18-865925f6debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870917df-4786-4c4a-949b-cac5de853ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870917df-4786-4c4a-949b-cac5de853ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-138095190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=585c7e47-06f6-4353-a74a-072d298691a3,host='devstack@QuobyteHD#QuobyteHD',id=c160330b-762e-4ff1-9a4a-fae0c3d15734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d138f4183e4ffebf155a9faa8e2694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:07Z,use_quota=True,user_id='2bffe98f2090432cb8cfb2727939943f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dbb897f-f08e-492d-84de-1d8021733323),volume_type_id=3dbb897f-f08e-492d-84de-1d8021733323)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba82dea8-471a-449d-84f4-81740bea751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba82dea8-471a-449d-84f4-81740bea751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc1ac16-ac80-43a1-8690-846344717d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc1ac16-ac80-43a1-8690-846344717d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c160330b-762e-4ff1-9a4a-fae0c3d15734', 'volume_name': 'volume-c160330b-762e-4ff1-9a4a-fae0c3d15734', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f1f419-6bb4-4786-a68b-540f99a503a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f1f419-6bb4-4786-a68b-540f99a503a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f243bc43-92e3-47ec-8dc5-bed5bf286ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Volume c160330b-762e-4ff1-9a4a-fae0c3d15734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c160330b-762e-4ff1-9a4a-fae0c3d15734', 'volume_size': 1} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (b707f825-8f15-4d2d-ac76-392d3a65479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28acebb8-9df0-4f18-8a44-6a6bf673b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28acebb8-9df0-4f18-8a44-6a6bf673b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1383812926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcadad50-69ed-4e8b-8a1d-a91af8eeacb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:07Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdb2848-71b2-40c1-a26e-fc1cc258cf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdb2848-71b2-40c1-a26e-fc1cc258cf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f9d145-db4b-4ebd-9f57-104f6e3770de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f9d145-db4b-4ebd-9f57-104f6e3770de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcadad50-69ed-4e8b-8a1d-a91af8eeacb4', 'volume_name': 'volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a451aa-d8d7-4dd6-88d3-c2de3bcd98f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a451aa-d8d7-4dd6-88d3-c2de3bcd98f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ce0523-b790-4b3b-b38a-16958910f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Volume dcadad50-69ed-4e8b-8a1d-a91af8eeacb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4', 'volume_size': 1} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd" returned: 0 in 0.655s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.971s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261672204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7f7a2a-7905-446b-ac7f-4d734e990855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:04Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Creating volume ad7f7a2a-7905-446b-ac7f-4d734e990855 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:07 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d0a92d-4417-4b1d-82aa-c4aedf1d47ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c380c9c-7869-4d55-977e-18989003dacd', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb1ef41-7010-4b19-8b73-1c9e49f561a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 1073741824 Sep 28 18:19:07 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Volume volume-0c380c9c-7869-4d55-977e-18989003dacd (0c380c9c-7869-4d55-977e-18989003dacd): created successfully Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb1ef41-7010-4b19-8b73-1c9e49f561a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (7d16aaf8-0d0e-4853-8df3-581a721b79c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1aba57e8-662f-4289-b904-55ed196ee9a9 tempest-CreateVolumesFromImageTest-631984083 None] Created volume successfully. Sep 28 18:19:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-0320fd54-a885-4b82-a167-31c37ed3c61d req-10605189-fa36-4803-94d0-8c125c446969 tempest-TestMinimumBasicScenario-644304430 None] Terminate volume connection completed successfully. Sep 28 18:19:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-0320fd54-a885-4b82-a167-31c37ed3c61d req-10605189-fa36-4803-94d0-8c125c446969 tempest-TestMinimumBasicScenario-644304430 None] Deleting attachment 3b7a9f65-b1e2-427f-a410-4a1f7b448869. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:19:08 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 1073741824" returned: 0 in 1.021s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:08 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 Sep 28 18:19:08 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:09 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855" returned: 0 in 0.420s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.270s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53995261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c829686-4dcc-460b-9fe0-eeedc349bcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:06Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Creating volume 3c829686-4dcc-460b-9fe0-eeedc349bcda {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:09 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd6ffdd-5c1d-4e6f-b0ec-bb907da9a03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7f7a2a-7905-446b-ac7f-4d734e990855', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:09 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda 1073741824 Sep 28 18:19:09 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383539ea-f6fe-4f15-9f5a-07c1b1c6543e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:09 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Volume volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 (ad7f7a2a-7905-446b-ac7f-4d734e990855): created successfully Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383539ea-f6fe-4f15-9f5a-07c1b1c6543e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (72049308-2fc4-4016-9a9f-a2f81f02b127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c723e04a-b361-4414-85d9-2d83bb633ca1 tempest-CreateVolumesFromImageTest-631984083 None] Created volume successfully. Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Acquiring lock "cinder-a9101ed5-7488-474a-8767-e3f957809676-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Lock "cinder-a9101ed5-7488-474a-8767-e3f957809676-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Acquiring lock "cinder-quobyte-a9101ed5-7488-474a-8767-e3f957809676" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Lock "cinder-quobyte-a9101ed5-7488-474a-8767-e3f957809676" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd57cab3-5e44-4c70-a669-ea4af419328d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:09 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 Sep 28 18:19:09 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:09 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda 1073741824" returned: 0 in 0.762s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:09 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda Sep 28 18:19:09 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:10 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676" returned: 0 in 0.594s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:10 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676 Sep 28 18:19:10 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:10 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda" returned: 0 in 0.297s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.860s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=585c7e47-06f6-4353-a74a-072d298691a3,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-138095190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=585c7e47-06f6-4353-a74a-072d298691a3,host='devstack@QuobyteHD#QuobyteHD',id=c160330b-762e-4ff1-9a4a-fae0c3d15734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d138f4183e4ffebf155a9faa8e2694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:07Z,use_quota=True,user_id='2bffe98f2090432cb8cfb2727939943f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dbb897f-f08e-492d-84de-1d8021733323),volume_type_id=3dbb897f-f08e-492d-84de-1d8021733323)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Creating volume c160330b-762e-4ff1-9a4a-fae0c3d15734 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:10 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66225a0d-4418-40f1-a2a9-9bb61c0f42b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c829686-4dcc-460b-9fe0-eeedc349bcda', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06cfe09-4825-4cd5-97cf-d87ff19e8a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:10 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 1073741824 Sep 28 18:19:10 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:10 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Volume volume-3c829686-4dcc-460b-9fe0-eeedc349bcda (3c829686-4dcc-460b-9fe0-eeedc349bcda): created successfully Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06cfe09-4825-4cd5-97cf-d87ff19e8a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (03ef25e4-3020-4bec-ae20-a9ecd31529e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:10 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-cc420836-f4bc-4eee-9d78-b65a88f2b2a2 tempest-CreateVolumesFromImageTest-631984083 None] Created volume successfully. Sep 28 18:19:10 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a9101ed5-7488-474a-8767-e3f957809676" returned: 0 in 0.299s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Lock "cinder-quobyte-a9101ed5-7488-474a-8767-e3f957809676" released by "delete_volume" :: held 0.977s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Created reservations ['bf125e30-c761-431e-bd8d-9acd051fe334', '2f75e0cd-c7f9-4b49-b1b6-32ee96183549', '371b48d9-1403-4a1c-85ca-a040c9c6ea4e', 'a1a27a2b-46e0-4f19-af43-18269f59a9f9'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:10 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:10 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:10 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 1073741824" returned: 0 in 0.655s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:11 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 Sep 28 18:19:11 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:11 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.406s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Deleted volume successfully. Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-75f94421-4562-410a-9a51-0f34d49ca794 tempest-TestMinimumBasicScenario-644304430 None] Lock "cinder-a9101ed5-7488-474a-8767-e3f957809676-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:11 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734" returned: 0 in 0.322s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.770s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1383812926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcadad50-69ed-4e8b-8a1d-a91af8eeacb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad16827d4b234aa48b70b860fc7a214d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:07Z,use_quota=True,user_id='f4ba7414107e4df5973c86917376787a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Creating volume dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:11 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:11 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 1073741824 Sep 28 18:19:11 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f243bc43-92e3-47ec-8dc5-bed5bf286ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c160330b-762e-4ff1-9a4a-fae0c3d15734', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cdd04b-2239-47c4-b6d2-2cdee60c5bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Volume volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 (c160330b-762e-4ff1-9a4a-fae0c3d15734): created successfully Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cdd04b-2239-47c4-b6d2-2cdee60c5bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Flow 'volume_create_manager' (d26588fe-5d19-4e71-8b18-865925f6debb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-84a381c7-3b57-43cb-8412-e443f5d2274d tempest-GroupsTest-1563497356 None] Created volume successfully. Sep 28 18:19:12 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 1073741824" returned: 0 in 0.728s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:12 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 Sep 28 18:19:12 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "cinder-ac6ce344-febf-4e80-a800-d81b7e12d55f-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-ac6ce344-febf-4e80-a800-d81b7e12d55f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "cinder-quobyte-ac6ce344-febf-4e80-a800-d81b7e12d55f" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-quobyte-ac6ce344-febf-4e80-a800-d81b7e12d55f" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bca8ab-3dc1-4d31-b144-1add80c51fdb]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:12 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4" returned: 0 in 0.395s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ce0523-b790-4b3b-b38a-16958910f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f3a3ac-7908-461c-8aeb-14184d969ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:12 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Volume volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 (dcadad50-69ed-4e8b-8a1d-a91af8eeacb4): created successfully Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f3a3ac-7908-461c-8aeb-14184d969ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:12 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f Sep 28 18:19:12 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Flow 'volume_create_manager' (b707f825-8f15-4d2d-ac76-392d3a65479a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:12 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c1516e69-2623-4318-9c19-8d822a34a445 tempest-CreateVolumesFromImageTest-631984083 None] Created volume successfully. Sep 28 18:19:13 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f" returned: 0 in 0.738s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:13 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f Sep 28 18:19:13 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-quobyte-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2342d52d-218e-4432-8d3f-b56ab3483251]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Acquiring lock "cinder-quobyte-c160330b-762e-4ff1-9a4a-fae0c3d15734" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Lock "cinder-quobyte-c160330b-762e-4ff1-9a4a-fae0c3d15734" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb08ec-226a-498d-8714-5f68c6beea39]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:13 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 Sep 28 18:19:13 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:13 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac6ce344-febf-4e80-a800-d81b7e12d55f" returned: 0 in 0.510s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-quobyte-ac6ce344-febf-4e80-a800-d81b7e12d55f" released by "delete_volume" :: held 1.336s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:13 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 Sep 28 18:19:13 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Created reservations ['ec9d572f-8e3b-43aa-ba67-eb982abe23c8', '0fb96c98-0ca5-4867-954c-1c2b981a8b2d', '52b7ad53-8b3a-411a-bf0a-8973287da0d2', '53f8f716-59cf-43e1-a1d3-1144ac0bd5d7'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:13 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4" returned: 0 in 0.574s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:14 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4 Sep 28 18:19:14 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734" returned: 0 in 0.603s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734 Sep 28 18:19:14 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4" returned: 0 in 0.348s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.393s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Deleted volume successfully. Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4" released by "delete_volume" :: held 1.049s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-043d31ed-487f-4f23-95fa-349e2558fb37 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-ac6ce344-febf-4e80-a800-d81b7e12d55f-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Created reservations ['32432957-a932-4411-8840-f6f30f6b5746', '9224f7a3-275f-4a5d-9c22-812dd3cc5715', '444a8768-e2c9-423b-a9e8-286da3dfcea2', '67aae5e2-b3d2-47f7-970f-a784f028b2d0'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:14 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c160330b-762e-4ff1-9a4a-fae0c3d15734" returned: 0 in 0.370s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Lock "cinder-quobyte-c160330b-762e-4ff1-9a4a-fae0c3d15734" released by "delete_volume" :: held 1.066s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:14 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Created reservations ['8353bf68-6ad4-47c6-8c09-ae6fbb870648'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "cinder-5bd18c38-75dc-4a5d-be68-0861dbdc63f3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-5bd18c38-75dc-4a5d-be68-0861dbdc63f3-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:14 devstack cinder-volume[86981]: WARNING cinder.quota [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-726050604 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-726050604, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:14 devstack cinder-volume[86981]: WARNING cinder.quota [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-726050604 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-726050604, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Created reservations ['27c76586-9421-494e-94df-3fb498d34ecb', '21b90c35-6904-4ea3-ab1e-daa2857f936f', '5ea5ac94-43b6-4ea6-bb1b-656afc10d0de', 'b96326da-0bb5-45bc-bab6-837cff249cf3'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "cinder-quobyte-5bd18c38-75dc-4a5d-be68-0861dbdc63f3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-quobyte-5bd18c38-75dc-4a5d-be68-0861dbdc63f3" acquired by "delete_volume" :: waited 0.042s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdaf962-c493-4d05-a30b-9be3045bb0f6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:15 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.542s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Deleted volume successfully. Sep 28 18:19:15 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:15 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:15 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 Sep 28 18:19:15 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0a9481d7-397e-465c-ae58-42655afb9d72 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-dcadad50-69ed-4e8b-8a1d-a91af8eeacb4-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:15 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.338s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-60ad82ca-5960-4ecf-bcd4-528b82ed0666 tempest-GroupsTest-1563497356 None] Delete group completed successfully. Sep 28 18:19:15 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3" returned: 0 in 0.574s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-3c829686-4dcc-460b-9fe0-eeedc349bcda-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:15 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3 Sep 28 18:19:15 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-3c829686-4dcc-460b-9fe0-eeedc349bcda-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-quobyte-3c829686-4dcc-460b-9fe0-eeedc349bcda" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-3c829686-4dcc-460b-9fe0-eeedc349bcda" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2a5b80-a5f9-4529-983a-82d192324476]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:15 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda Sep 28 18:19:15 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:15 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5bd18c38-75dc-4a5d-be68-0861dbdc63f3" returned: 0 in 0.406s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-quobyte-5bd18c38-75dc-4a5d-be68-0861dbdc63f3" released by "delete_volume" :: held 1.062s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Created reservations ['43b49c68-e435-4d22-bf17-b6fb5925bcce', 'bc1b95ba-5e69-4573-b8ef-a0472dab3d51', 'd58622a3-c4ce-4627-939e-56d312d66301', 'da36a1b2-2871-4d0d-9813-5d0218e63958'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:16 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:16 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:16 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda" returned: 0 in 0.690s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Created reservations ['73e12726-b5b0-41d0-841c-f9643b2b7a62'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:16 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda Sep 28 18:19:16 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:16 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.409s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Deleted volume successfully. Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4f116925-7cca-4fdc-84e7-c8184d30d930 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-5bd18c38-75dc-4a5d-be68-0861dbdc63f3-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:16 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:16 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:17 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3c829686-4dcc-460b-9fe0-eeedc349bcda" returned: 0 in 0.558s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-3c829686-4dcc-460b-9fe0-eeedc349bcda" released by "delete_volume" :: held 1.352s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:17 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.490s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e7184e5b-6d17-462c-8096-b3c32fe6eee3 tempest-GroupsTest-1563497356 None] Delete group completed successfully. Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Created reservations ['6bfd6e7b-14ee-464c-a228-e0d1cf901678', '216b76e5-cf09-4b98-b0ba-64dc244efddc', '962f0f0e-f9a7-4680-9c37-72bd0fd4cec9', 'ea397807-466a-4ab4-ab06-88aec19c540e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:17 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:17 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "cinder-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "cinder-quobyte-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-quobyte-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[458fd995-4ac0-47f7-906c-9b7bd766ea95]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:17 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.503s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:17 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 Sep 28 18:19:17 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Deleted volume successfully. Sep 28 18:19:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99f37f68-b215-4fd0-8610-980eea191978 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-3c829686-4dcc-460b-9fe0-eeedc349bcda-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-ad7f7a2a-7905-446b-ac7f-4d734e990855-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-ad7f7a2a-7905-446b-ac7f-4d734e990855-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-quobyte-ad7f7a2a-7905-446b-ac7f-4d734e990855" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-ad7f7a2a-7905-446b-ac7f-4d734e990855" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64353c-2e27-4188-96d2-7358804d34c4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:18 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838" returned: 0 in 0.671s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:18 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838 Sep 28 18:19:18 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:18 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 Sep 28 18:19:18 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7273d388-fbe1-4de1-83a3-5c307d322edc tempest-GroupsTest-1563497356 None] Group tempest-GroupsTest-Group-110648057: creating Sep 28 18:19:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7273d388-fbe1-4de1-83a3-5c307d322edc tempest-GroupsTest-1563497356 None] Group tempest-GroupsTest-Group-110648057: created successfully Sep 28 18:19:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7273d388-fbe1-4de1-83a3-5c307d322edc tempest-GroupsTest-1563497356 None] Create group completed successfully. Sep 28 18:19:18 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838" returned: 0 in 0.513s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-quobyte-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838" released by "delete_volume" :: held 1.269s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Created reservations ['ee958408-b799-4914-a2d8-e94c7fb5217d', '18f9a87a-2df2-46a9-8e6b-5ecdcd54cfb2', '4099aa5e-a7f3-4338-b6e9-87f2256f913e', '330423a6-01cc-46df-96a0-399b63127510'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:19 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855" returned: 0 in 0.726s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:19 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855 Sep 28 18:19:19 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:19 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:19 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:19 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:19 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ad7f7a2a-7905-446b-ac7f-4d734e990855" returned: 0 in 0.583s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.475s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-ad7f7a2a-7905-446b-ac7f-4d734e990855" released by "delete_volume" :: held 1.374s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Deleted volume successfully. Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1a7f90f1-94b8-4412-b12c-2212080ad380 tempest-AttachVolumeNegativeTest-1997790671 None] Lock "cinder-fcf4bea3-8d8f-4ca0-9832-0b6dd5d8d838-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Created reservations ['31398d93-e651-4f66-8d10-fa05008c1ffe', '79353b23-8ec6-46f7-8068-e527518bfd9c', '5b1467f2-d78c-4c40-95b0-91d24467484e', '71d087b1-b7d5-4973-bfa6-5c68256e8a6a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:19 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:19 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:20 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.373s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:20 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Deleted volume successfully. Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e965018b-8186-4690-bc1f-cd7cd1757dc9 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-ad7f7a2a-7905-446b-ac7f-4d734e990855-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Flow 'volume_create_manager' (cff61adb-7449-4662-ae86-6189b11e2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615a3850-9838-4bfb-a007-241fb63a81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-0c380c9c-7869-4d55-977e-18989003dacd-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615a3850-9838-4bfb-a007-241fb63a81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717174015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4a8aea0-8d2c-451d-b1b1-e195173c8140,host='devstack@QuobyteHD#QuobyteHD',id=a852aaee-5d1f-41a6-85a7-3ccb1d9a3335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d138f4183e4ffebf155a9faa8e2694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:21Z,use_quota=True,user_id='2bffe98f2090432cb8cfb2727939943f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1ef30c6-4ab4-483e-9f05-0c9645162ae6),volume_type_id=f1ef30c6-4ab4-483e-9f05-0c9645162ae6)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5534e9c4-05fd-493f-861d-904c14530037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5534e9c4-05fd-493f-861d-904c14530037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422cdace-9255-40b1-b5ec-423f1d4ee7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422cdace-9255-40b1-b5ec-423f1d4ee7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a852aaee-5d1f-41a6-85a7-3ccb1d9a3335', 'volume_name': 'volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4d3c5f-d1b1-458c-8db8-6bf4e8e72720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4d3c5f-d1b1-458c-8db8-6bf4e8e72720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c5fbf6-d545-45fe-be5c-442f5ef0ebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Volume a852aaee-5d1f-41a6-85a7-3ccb1d9a3335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335', 'volume_size': 1} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4a8aea0-8d2c-451d-b1b1-e195173c8140,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717174015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4a8aea0-8d2c-451d-b1b1-e195173c8140,host='devstack@QuobyteHD#QuobyteHD',id=a852aaee-5d1f-41a6-85a7-3ccb1d9a3335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d138f4183e4ffebf155a9faa8e2694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:21Z,use_quota=True,user_id='2bffe98f2090432cb8cfb2727939943f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1ef30c6-4ab4-483e-9f05-0c9645162ae6),volume_type_id=f1ef30c6-4ab4-483e-9f05-0c9645162ae6)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Creating volume a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:20 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-0c380c9c-7869-4d55-977e-18989003dacd-delete_volume" acquired by "delete_volume" :: waited 0.142s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:20 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 1073741824 Sep 28 18:19:20 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-quobyte-0c380c9c-7869-4d55-977e-18989003dacd" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-0c380c9c-7869-4d55-977e-18989003dacd" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[94029df5-141d-4c11-8d86-b78d55ffcc9f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:21 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd Sep 28 18:19:21 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:21 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 1073741824" returned: 0 in 0.666s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:21 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd" returned: 0 in 0.561s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:21 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd Sep 28 18:19:21 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:21 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0c380c9c-7869-4d55-977e-18989003dacd" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:21 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 Sep 28 18:19:21 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-0c380c9c-7869-4d55-977e-18989003dacd" released by "delete_volume" :: held 1.000s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Created reservations ['4ff62aea-c363-45a1-a419-fb943314a981', 'e3cd3d63-5ca8-41a7-a383-e476eaa222c6', '38c1fc4d-6a5d-47f6-b002-60ba255b20a4', '6eb4407c-81f2-489a-8c17-bb8a0b5b1aef'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:22 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:22 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:22 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335" returned: 0 in 0.592s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c5fbf6-d545-45fe-be5c-442f5ef0ebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdc4871-db35-4b49-9ded-d7af094d5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:22 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Volume volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 (a852aaee-5d1f-41a6-85a7-3ccb1d9a3335): created successfully Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdc4871-db35-4b49-9ded-d7af094d5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Flow 'volume_create_manager' (cff61adb-7449-4662-ae86-6189b11e2a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-80560800-4f37-428f-b5c8-92bfc241c674 tempest-GroupsTest-1563497356 None] Created volume successfully. Sep 28 18:19:22 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.299s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Deleted volume successfully. Sep 28 18:19:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-45170b87-9bdf-44c6-b366-fb0575382555 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-0c380c9c-7869-4d55-977e-18989003dacd-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-6affcd36-8246-4cba-a272-36329fcbe368-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-6affcd36-8246-4cba-a272-36329fcbe368-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "cinder-quobyte-6affcd36-8246-4cba-a272-36329fcbe368" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-6affcd36-8246-4cba-a272-36329fcbe368" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61753a8-68ad-4e7b-abdf-0667991a524f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:23 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 Sep 28 18:19:23 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:23 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368" returned: 0 in 0.714s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:24 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368 Sep 28 18:19:24 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:24 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6affcd36-8246-4cba-a272-36329fcbe368" returned: 0 in 0.490s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-quobyte-6affcd36-8246-4cba-a272-36329fcbe368" released by "delete_volume" :: held 1.276s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Flow 'volume_create_manager' (89798785-d4c8-4614-904c-badd83d9043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630b2743-b143-4f91-b9d0-c9fbe45f2f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630b2743-b143-4f91-b9d0-c9fbe45f2f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131573344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4a8aea0-8d2c-451d-b1b1-e195173c8140,host='devstack@QuobyteHD#QuobyteHD',id=41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d138f4183e4ffebf155a9faa8e2694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:24Z,use_quota=True,user_id='2bffe98f2090432cb8cfb2727939943f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1ef30c6-4ab4-483e-9f05-0c9645162ae6),volume_type_id=f1ef30c6-4ab4-483e-9f05-0c9645162ae6)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0c8f5b-cd24-40f3-ac96-445c97abdb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0c8f5b-cd24-40f3-ac96-445c97abdb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6451edf0-e2f4-47d8-806f-4fdf5c758772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6451edf0-e2f4-47d8-806f-4fdf5c758772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1', 'volume_name': 'volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efac5edf-2a13-43e0-9922-17fcfe3b2399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efac5edf-2a13-43e0-9922-17fcfe3b2399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5dde29-b16e-4b36-bfe6-8971f6142e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:24 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Volume 41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1', 'volume_size': 1} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4a8aea0-8d2c-451d-b1b1-e195173c8140,created_at=2026-09-28T16:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131573344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4a8aea0-8d2c-451d-b1b1-e195173c8140,host='devstack@QuobyteHD#QuobyteHD',id=41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d138f4183e4ffebf155a9faa8e2694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:24Z,use_quota=True,user_id='2bffe98f2090432cb8cfb2727939943f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1ef30c6-4ab4-483e-9f05-0c9645162ae6),volume_type_id=f1ef30c6-4ab4-483e-9f05-0c9645162ae6)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Creating volume 41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:24 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:24 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 1073741824 Sep 28 18:19:24 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Created reservations ['b17faee1-f8ff-4a97-bdd2-2d576e18ec35', '29c1a1cb-d104-40a1-99eb-e06a3db2a53d', '70cf3dc6-13dc-4636-872d-75250377ceb9', 'e975001c-4a80-4a46-a8d3-5416cc19d902'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:24 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:24 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:25 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.451s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Deleted volume successfully. Sep 28 18:19:25 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-286bcc8e-e666-4052-83d8-87bb9a04df53 tempest-CreateVolumesFromImageTest-631984083 None] Lock "cinder-6affcd36-8246-4cba-a272-36329fcbe368-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 1073741824" returned: 0 in 0.795s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:25 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 Sep 28 18:19:25 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:25 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1" returned: 0 in 0.322s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5dde29-b16e-4b36-bfe6-8971f6142e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aebd5d4-9acb-4ea1-9a08-4e09e0b46f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:25 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Volume volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 (41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1): created successfully Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aebd5d4-9acb-4ea1-9a08-4e09e0b46f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Flow 'volume_create_manager' (89798785-d4c8-4614-904c-badd83d9043e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e7aa7058-fa06-4c46-979c-01e1da00c8a3 tempest-GroupsTest-1563497356 None] Created volume successfully. Sep 28 18:19:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3b049b6b-ea61-4e9d-90bb-0eb3f6a552df tempest-GroupsTest-1563497356 None] Update group completed successfully. Sep 28 18:19:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-110e3bd0-821c-416e-86ca-5c67cd319919 tempest-GroupsTest-1563497356 None] Update group completed successfully. Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (d10f92f7-32a2-49a7-870e-c71d8d6188de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba48adff-1def-4056-bce9-744e78a7b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba48adff-1def-4056-bce9-744e78a7b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1616750900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3c5c2c-1758-425b-9304-877beec8fb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:31Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8758e8da-2cb0-440c-a77e-2c190eb9ac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8758e8da-2cb0-440c-a77e-2c190eb9ac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a6c0e8-7386-4f47-88ab-d2525f57d7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a6c0e8-7386-4f47-88ab-d2525f57d7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3c5c2c-1758-425b-9304-877beec8fb94', 'volume_name': 'volume-6c3c5c2c-1758-425b-9304-877beec8fb94', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a75dc18-0b79-4cee-802f-f76197529896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a75dc18-0b79-4cee-802f-f76197529896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dbba13-3b0e-4ae8-bd47-cecccb2fa0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:30 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume 6c3c5c2c-1758-425b-9304-877beec8fb94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3c5c2c-1758-425b-9304-877beec8fb94', 'volume_size': 1} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1616750900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3c5c2c-1758-425b-9304-877beec8fb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:31Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Creating volume 6c3c5c2c-1758-425b-9304-877beec8fb94 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:30 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:30 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 1073741824 Sep 28 18:19:30 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Acquiring lock "cinder-quobyte-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Lock "cinder-quobyte-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1" acquired by "delete_volume" :: waited 0.042s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef63f7b-2ee4-4cd7-8f20-6ebcb82c862a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:31 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 Sep 28 18:19:31 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:31 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 1073741824" returned: 0 in 0.784s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:31 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 Sep 28 18:19:31 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:31 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1" returned: 0 in 0.666s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:31 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1 Sep 28 18:19:31 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:31 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94" returned: 0 in 0.420s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dbba13-3b0e-4ae8-bd47-cecccb2fa0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3c5c2c-1758-425b-9304-877beec8fb94', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4681fb2a-6e0e-46e7-97eb-650ae67f47dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:32 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume volume-6c3c5c2c-1758-425b-9304-877beec8fb94 (6c3c5c2c-1758-425b-9304-877beec8fb94): created successfully Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4681fb2a-6e0e-46e7-97eb-650ae67f47dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (d10f92f7-32a2-49a7-870e-c71d8d6188de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:32 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8f1b5ea3-e180-4d01-b431-24e8567da5cd tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created volume successfully. Sep 28 18:19:32 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1" returned: 0 in 0.347s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Lock "cinder-quobyte-41ec03eb-c45c-4f95-ab17-0ac1b1acc0b1" released by "delete_volume" :: held 1.110s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Acquiring lock "cinder-quobyte-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Lock "cinder-quobyte-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[47299f9f-de92-44b5-bc90-a1e625aa8055]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:32 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 Sep 28 18:19:32 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:32 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335" returned: 0 in 0.470s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:32 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335 Sep 28 18:19:32 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:33 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Lock "cinder-quobyte-a852aaee-5d1f-41a6-85a7-3ccb1d9a3335" released by "delete_volume" :: held 0.945s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Created reservations ['cd512a0b-d777-409a-b290-03b9f6fe2a5d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:33 devstack cinder-volume[86981]: WARNING cinder.quota [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-428615112 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-428615112, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:33 devstack cinder-volume[86981]: WARNING cinder.quota [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-428615112 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-428615112, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Created reservations ['39b390aa-de36-4eda-846c-dbce1571b7a7', '6733a0dd-f095-4a34-aa9e-26d1c89ee4fb', '0cf5ac82-8242-466e-9552-b9e464f6ab91', '19851059-5a8a-410b-b0c2-d7d6d1a16df5'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (616dd873-1791-46be-8943-3805ab8d2648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243cbb2e-6afd-448c-aafb-03d189cda766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243cbb2e-6afd-448c-aafb-03d189cda766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2069743040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c358790-ea9d-43a3-9260-4a42e394d3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:33Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22deb99-7a54-4af3-8992-d3ac64b537b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22deb99-7a54-4af3-8992-d3ac64b537b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926cdd5c-1c0a-47ac-842f-1d0b2f47e526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926cdd5c-1c0a-47ac-842f-1d0b2f47e526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c358790-ea9d-43a3-9260-4a42e394d3e3', 'volume_name': 'volume-2c358790-ea9d-43a3-9260-4a42e394d3e3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87be4a-e530-4bea-a0fe-84a9d7bce3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87be4a-e530-4bea-a0fe-84a9d7bce3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68295edd-8e11-4be9-816c-304f26e7ef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume 2c358790-ea9d-43a3-9260-4a42e394d3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c358790-ea9d-43a3-9260-4a42e394d3e3', 'volume_size': 1} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2069743040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c358790-ea9d-43a3-9260-4a42e394d3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:33Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Creating volume 2c358790-ea9d-43a3-9260-4a42e394d3e3 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:33 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:33 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 1073741824 Sep 28 18:19:33 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:33 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Created reservations ['6f0efb7a-b32e-4b32-a23b-b84fb321f1ac', '564750bc-6c04-466d-a9ae-fffeffde8405', '440b0e55-81c5-4546-8c88-d4ab65a64d62', '83fc0681-f6f2-4d4f-8913-477ece6fa90e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:34 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 1073741824" returned: 0 in 0.887s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.498s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:34 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8732ffd7-a295-41ed-8580-d01d8093a199 tempest-GroupsTest-1563497356 None] Delete group completed successfully. Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 Sep 28 18:19:34 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (950c7ac6-5cf6-43fb-aae6-841f3d58cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66ae480-3062-46c3-b813-6a49f7c79d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66ae480-3062-46c3-b813-6a49f7c79d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1726916847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f50b5a1-8d60-4e82-bd5e-231c6eab298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:34Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4877244-7b9b-4b33-9077-e7faa1f9c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4877244-7b9b-4b33-9077-e7faa1f9c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a1f028-ad4d-4667-a72d-c443bcba58a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a1f028-ad4d-4667-a72d-c443bcba58a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f50b5a1-8d60-4e82-bd5e-231c6eab298b', 'volume_name': 'volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35dc590-df30-48d8-91f4-0fe999f98314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35dc590-df30-48d8-91f4-0fe999f98314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee89ce63-cd15-4f55-9c30-f8dc921e1184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume 6f50b5a1-8d60-4e82-bd5e-231c6eab298b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b', 'volume_size': 1} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:35 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3" returned: 0 in 0.680s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.169s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1726916847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f50b5a1-8d60-4e82-bd5e-231c6eab298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:34Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Creating volume 6f50b5a1-8d60-4e82-bd5e-231c6eab298b {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:35 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68295edd-8e11-4be9-816c-304f26e7ef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c358790-ea9d-43a3-9260-4a42e394d3e3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c4a5b-35e8-41f9-a2e6-a2b24b6520e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b 1073741824 Sep 28 18:19:35 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 (2c358790-ea9d-43a3-9260-4a42e394d3e3): created successfully Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c4a5b-35e8-41f9-a2e6-a2b24b6520e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (616dd873-1791-46be-8943-3805ab8d2648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e600d3fe-acea-4c03-b209-f437cf312f87 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created volume successfully. Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Flow 'volume_create_manager' (ef96232c-63cf-4f35-9528-4f59be988f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24847dc3-5e0d-4900-885b-a2d707a82d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24847dc3-5e0d-4900-885b-a2d707a82d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1693400457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fa6540-9322-4bf3-8301-1314069e9184,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b900d4457e4d4113bc8dd851e8e67f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:35Z,use_quota=True,user_id='43890b354e3f42b4aa6a4ab133be92a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2bee6c-a951-4dbc-b103-9fccff563cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2bee6c-a951-4dbc-b103-9fccff563cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f4738b-3934-4cbd-8124-d26dff2c3e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f4738b-3934-4cbd-8124-d26dff2c3e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60fa6540-9322-4bf3-8301-1314069e9184', 'volume_name': 'volume-60fa6540-9322-4bf3-8301-1314069e9184', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef21948b-68a5-4ef8-b08f-317eaa4547b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef21948b-68a5-4ef8-b08f-317eaa4547b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9557e5-ec33-419e-ab74-e5ed28cf94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Volume 60fa6540-9322-4bf3-8301-1314069e9184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60fa6540-9322-4bf3-8301-1314069e9184', 'volume_size': 1} Sep 28 18:19:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (7cebc73a-42de-4983-af38-fa21ee69a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47fe0f3-e68a-4592-8738-22e287fde3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47fe0f3-e68a-4592-8738-22e287fde3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432563172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e8d7ab-d45e-4956-b6dc-8e1ff726e950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:36Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6466e330-83ff-42bf-b262-4a177a543db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6466e330-83ff-42bf-b262-4a177a543db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc91ee3-c589-435c-9eab-bb6c0e5edad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc91ee3-c589-435c-9eab-bb6c0e5edad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e8d7ab-d45e-4956-b6dc-8e1ff726e950', 'volume_name': 'volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12dfca2-d167-458b-ba80-764702f7fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12dfca2-d167-458b-ba80-764702f7fe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf61dfb-3344-4ec6-baf8-7be257f1d80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume c0e8d7ab-d45e-4956-b6dc-8e1ff726e950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950', 'volume_size': 1} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b 1073741824" returned: 0 in 0.988s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (cbe3a980-5060-49ee-8c7e-24f7224a2633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8f81f5-a1e3-45a5-b3aa-39301b77b1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8f81f5-a1e3-45a5-b3aa-39301b77b1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-170706977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a68dc86-70a3-4df7-b310-b26aa1197305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:36Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5ed909-664e-45b4-8ae4-8da95f9c219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b Sep 28 18:19:36 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5ed909-664e-45b4-8ae4-8da95f9c219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442d5fd8-acb2-4a04-95ff-8fc9d1b7d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442d5fd8-acb2-4a04-95ff-8fc9d1b7d7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a68dc86-70a3-4df7-b310-b26aa1197305', 'volume_name': 'volume-3a68dc86-70a3-4df7-b310-b26aa1197305', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb4456d-ca27-4aa3-af72-29a373b5e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb4456d-ca27-4aa3-af72-29a373b5e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72812a3d-9e92-4a2c-9598-1b61db8b66f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume 3a68dc86-70a3-4df7-b310-b26aa1197305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a68dc86-70a3-4df7-b310-b26aa1197305', 'volume_size': 1} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (6b4fc221-a479-49d4-bba3-f992d344182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42235f9-4326-49b2-aa60-3b3d6796b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42235f9-4326-49b2-aa60-3b3d6796b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592014904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b683df-033b-48a7-8a6a-b78101000fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:37Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d900a3-81ea-4ce3-8a0a-7285f9d47ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d900a3-81ea-4ce3-8a0a-7285f9d47ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143e648d-2ce5-4dd6-b810-481a0362ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143e648d-2ce5-4dd6-b810-481a0362ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b683df-033b-48a7-8a6a-b78101000fdd', 'volume_name': 'volume-58b683df-033b-48a7-8a6a-b78101000fdd', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01779302-f9e3-4f9b-b894-97d40d8cea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01779302-f9e3-4f9b-b894-97d40d8cea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed226571-f9e4-4aea-9d2a-2d4281d10ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume 58b683df-033b-48a7-8a6a-b78101000fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b683df-033b-48a7-8a6a-b78101000fdd', 'volume_size': 1} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:36 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b" returned: 0 in 0.393s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1693400457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fa6540-9322-4bf3-8301-1314069e9184,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b900d4457e4d4113bc8dd851e8e67f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:35Z,use_quota=True,user_id='43890b354e3f42b4aa6a4ab133be92a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Creating volume 60fa6540-9322-4bf3-8301-1314069e9184 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:36 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee89ce63-cd15-4f55-9c30-f8dc921e1184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3694fcbc-604f-452c-940c-69f38fee3f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 1073741824 Sep 28 18:19:36 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b (6f50b5a1-8d60-4e82-bd5e-231c6eab298b): created successfully Sep 28 18:19:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3694fcbc-604f-452c-940c-69f38fee3f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (950c7ac6-5cf6-43fb-aae6-841f3d58cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-79a00a5d-320c-4494-a27a-f56f40d75323 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created volume successfully. Sep 28 18:19:37 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 1073741824" returned: 0 in 0.671s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:37 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 Sep 28 18:19:37 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:38 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184" returned: 0 in 0.439s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-432563172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e8d7ab-d45e-4956-b6dc-8e1ff726e950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:36Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Creating volume c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:38 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9557e5-ec33-419e-ab74-e5ed28cf94a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fa6540-9322-4bf3-8301-1314069e9184', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:38 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 1073741824 Sep 28 18:19:38 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd116ff-29d6-4d28-a16a-21135b3ca7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:38 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Volume volume-60fa6540-9322-4bf3-8301-1314069e9184 (60fa6540-9322-4bf3-8301-1314069e9184): created successfully Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd116ff-29d6-4d28-a16a-21135b3ca7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Flow 'volume_create_manager' (ef96232c-63cf-4f35-9528-4f59be988f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-d93d5be1-91ed-496f-b5a9-df02bb2f2307 req-4c106a81-8f3a-489b-b38d-489055e2c92e tempest-VolumesGetTestJSON-1444508482 None] Created volume successfully. Sep 28 18:19:38 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 1073741824" returned: 0 in 0.628s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:38 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:38 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 Sep 28 18:19:38 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:19:39 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950" returned: 0 in 0.479s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.774s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-170706977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a68dc86-70a3-4df7-b310-b26aa1197305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:36Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Creating volume 3a68dc86-70a3-4df7-b310-b26aa1197305 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:39 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf61dfb-3344-4ec6-baf8-7be257f1d80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3edd54-b575-4859-95d7-94e4c3842c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:39 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 1073741824 Sep 28 18:19:39 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 (c0e8d7ab-d45e-4956-b6dc-8e1ff726e950): created successfully Sep 28 18:19:39 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3edd54-b575-4859-95d7-94e4c3842c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (7cebc73a-42de-4983-af38-fa21ee69a72a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:39 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-88ccea83-4eeb-49f2-a076-0cda1bee7dda tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created volume successfully. Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Acquiring lock "cinder-60fa6540-9322-4bf3-8301-1314069e9184-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Lock "cinder-60fa6540-9322-4bf3-8301-1314069e9184-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:40 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Acquiring lock "cinder-quobyte-60fa6540-9322-4bf3-8301-1314069e9184" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 1073741824" returned: 0 in 0.892s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Lock "cinder-quobyte-60fa6540-9322-4bf3-8301-1314069e9184" acquired by "delete_volume" :: waited 0.054s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e1897-4f70-479f-8ff9-3d935efd5b4a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:40 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 Sep 28 18:19:40 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:40 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 Sep 28 18:19:40 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:40 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305" returned: 0 in 0.319s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.913s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592014904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b683df-033b-48a7-8a6a-b78101000fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a535fb94054416bbe5d1e06f3996708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:37Z,use_quota=True,user_id='4b577e9236ba4314af2576fe7f1ab354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Creating volume 58b683df-033b-48a7-8a6a-b78101000fdd {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:40 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:40 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd 1073741824 Sep 28 18:19:40 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72812a3d-9e92-4a2c-9598-1b61db8b66f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a68dc86-70a3-4df7-b310-b26aa1197305', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25309e6-135c-4d1e-9eb4-c4ac3a89964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:40 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume volume-3a68dc86-70a3-4df7-b310-b26aa1197305 (3a68dc86-70a3-4df7-b310-b26aa1197305): created successfully Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25309e6-135c-4d1e-9eb4-c4ac3a89964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (cbe3a980-5060-49ee-8c7e-24f7224a2633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d5461123-21c9-4d07-9514-ac3ac4a9fb1d tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created volume successfully. Sep 28 18:19:40 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184" returned: 0 in 0.546s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:40 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184 Sep 28 18:19:40 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:41 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60fa6540-9322-4bf3-8301-1314069e9184" returned: 0 in 0.372s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Lock "cinder-quobyte-60fa6540-9322-4bf3-8301-1314069e9184" released by "delete_volume" :: held 0.994s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG cinder.quota [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Created reservations ['14bffd4a-4005-4f35-95a1-55dbc3e1b6c9', '8247d73f-0043-439a-bd32-bc4385606236', '1280738f-0f98-470e-945e-77bda2a219e1', '39e02652-1857-408e-9c2d-3ad5e917dd45'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:41 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:41 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:41 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd 1073741824" returned: 0 in 0.901s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:41 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd Sep 28 18:19:41 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:41 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.412s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:41 devstack cinder-volume[86981]: DEBUG cinder.manager [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Deleted volume successfully. Sep 28 18:19:42 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed226571-f9e4-4aea-9d2a-2d4281d10ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b683df-033b-48a7-8a6a-b78101000fdd', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd260cb-7dc0-421f-8862-0ef3609e2470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-ba578bdc-12bc-4fe8-a20f-67ea8d980a70 req-88e49865-6997-4633-99d4-69ba4bf2832d tempest-VolumesGetTestJSON-1444508482 None] Lock "cinder-60fa6540-9322-4bf3-8301-1314069e9184-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:42 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Volume volume-58b683df-033b-48a7-8a6a-b78101000fdd (58b683df-033b-48a7-8a6a-b78101000fdd): created successfully Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd260cb-7dc0-421f-8862-0ef3609e2470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Flow 'volume_create_manager' (6b4fc221-a479-49d4-bba3-f992d344182e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d5590597-a0a1-4d05-ba46-2637346e346c tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created volume successfully. Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-58b683df-033b-48a7-8a6a-b78101000fdd-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-58b683df-033b-48a7-8a6a-b78101000fdd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-quobyte-58b683df-033b-48a7-8a6a-b78101000fdd" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-58b683df-033b-48a7-8a6a-b78101000fdd" acquired by "delete_volume" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d74a1c6-b413-41b2-b3d7-d0f64dc4235a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:42 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd Sep 28 18:19:42 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:43 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd" returned: 0 in 0.671s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:43 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd Sep 28 18:19:43 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:43 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-58b683df-033b-48a7-8a6a-b78101000fdd" returned: 0 in 0.393s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-58b683df-033b-48a7-8a6a-b78101000fdd" released by "delete_volume" :: held 1.140s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created reservations ['f3f91ac5-cf78-4292-a232-4086ba1bd920', '4ab1ee42-f54c-4270-bdb1-b282408ce69d', 'a443c344-72f2-41f1-a8e7-0f810ba7a26f', '6da483e8-8a06-43c6-a365-0e3b60ba59b8'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:44 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:44 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:44 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.344s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:44 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:44 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Deleted volume successfully. Sep 28 18:19:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f320686c-9d53-4699-b346-1fd18d3a92e1 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-58b683df-033b-48a7-8a6a-b78101000fdd-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-3a68dc86-70a3-4df7-b310-b26aa1197305-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-3a68dc86-70a3-4df7-b310-b26aa1197305-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-quobyte-3a68dc86-70a3-4df7-b310-b26aa1197305" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-3a68dc86-70a3-4df7-b310-b26aa1197305" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:45 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f61ac-7fe0-465d-ab12-7dac36bbe8dc]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 Sep 28 18:19:45 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:45 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305" returned: 0 in 0.497s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305 Sep 28 18:19:45 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a68dc86-70a3-4df7-b310-b26aa1197305" returned: 0 in 0.536s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-3a68dc86-70a3-4df7-b310-b26aa1197305" released by "delete_volume" :: held 1.133s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created reservations ['fadf4ab3-c42c-4d4c-82cc-c7f8405634f3', 'fdef8c6f-80bf-4d14-a73c-3f1d6ddd6f45', '530a2816-626a-4811-9a69-265f09a16599', '819a1ca1-9a40-4d33-8ac6-9f49de0f1f45'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:46 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:46 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.513s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:46 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Deleted volume successfully. Sep 28 18:19:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-268f5896-2849-4f75-a9db-955c5f9ad5a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-3a68dc86-70a3-4df7-b310-b26aa1197305-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-quobyte-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1390d227-8039-474f-9254-ab6bfd8fdf71]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:47 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 Sep 28 18:19:47 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950" returned: 0 in 0.597s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:48 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950 Sep 28 18:19:48 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:48 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950" returned: 0 in 0.553s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950" released by "delete_volume" :: held 1.224s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:48 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created reservations ['17e2d35a-b666-4f5a-81ee-726045340ecb', '95925623-cafe-4236-bedf-da2c498d38a0', 'c168b6c2-d95c-4414-b4a8-66ed0943f388', 'b26abef4-a23a-47ab-81f2-ced662ce96f5'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:49 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:49 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.439s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Deleted volume successfully. Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9b6974c8-3ec6-4713-9640-0de98c653667 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-c0e8d7ab-d45e-4956-b6dc-8e1ff726e950-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-6f50b5a1-8d60-4e82-bd5e-231c6eab298b-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-6f50b5a1-8d60-4e82-bd5e-231c6eab298b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-quobyte-6f50b5a1-8d60-4e82-bd5e-231c6eab298b" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-6f50b5a1-8d60-4e82-bd5e-231c6eab298b" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5cff33-17f1-4d3e-91a1-5109cc14588f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:50 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b Sep 28 18:19:50 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:50 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b" returned: 0 in 0.578s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:50 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b Sep 28 18:19:50 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-18c4e1e6-7a7e-4c4f-848a-79eeee334d0c tempest-GroupSnapshotsTest-1912329485 None] Group tempest-GroupSnapshotsTest-Group-283681586: creating Sep 28 18:19:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-18c4e1e6-7a7e-4c4f-848a-79eeee334d0c tempest-GroupSnapshotsTest-1912329485 None] Group tempest-GroupSnapshotsTest-Group-283681586: created successfully Sep 28 18:19:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-18c4e1e6-7a7e-4c4f-848a-79eeee334d0c tempest-GroupSnapshotsTest-1912329485 None] Create group completed successfully. Sep 28 18:19:51 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6f50b5a1-8d60-4e82-bd5e-231c6eab298b" returned: 0 in 0.597s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-6f50b5a1-8d60-4e82-bd5e-231c6eab298b" released by "delete_volume" :: held 1.241s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created reservations ['08512f66-3f94-4d11-8e03-c85fa695075f', 'd1cdd5dd-0a02-4b7b-89c7-a889fb03b621', '0a6f245a-5880-4a2c-b1d7-b437a6eb8673', '771b58d1-d0a4-4c65-9285-97160888f160'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:51 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:51 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:51 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.300s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Deleted volume successfully. Sep 28 18:19:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a070f5ea-234e-4aea-a2cf-e801e27384bf tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-6f50b5a1-8d60-4e82-bd5e-231c6eab298b-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-2c358790-ea9d-43a3-9260-4a42e394d3e3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-2c358790-ea9d-43a3-9260-4a42e394d3e3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-quobyte-2c358790-ea9d-43a3-9260-4a42e394d3e3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-2c358790-ea9d-43a3-9260-4a42e394d3e3" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be1845-6abb-4838-a9f0-7d50214c018d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:52 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 Sep 28 18:19:52 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (8caa50d8-2af3-40c2-bb52-5151ae32f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2c77bc-362b-4374-b067-d99d72747e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2c77bc-362b-4374-b067-d99d72747e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752099855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1691b9b7-d620-4df3-b5ee-e5bd99ed10fb,host='devstack@QuobyteHD#QuobyteHD',id=87fa9269-42e8-4f9e-a2d6-350381c027b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:53Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beb45572-3577-487a-a250-9b99e52410bc),volume_type_id=beb45572-3577-487a-a250-9b99e52410bc)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70610549-b244-4cb8-bd80-5452a2e5b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70610549-b244-4cb8-bd80-5452a2e5b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea49d049-f8c5-4273-8244-d8fab50c608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea49d049-f8c5-4273-8244-d8fab50c608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fa9269-42e8-4f9e-a2d6-350381c027b7', 'volume_name': 'volume-87fa9269-42e8-4f9e-a2d6-350381c027b7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb87ab95-74f0-41a9-a6e0-042b6b289de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb87ab95-74f0-41a9-a6e0-042b6b289de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb828e06-3152-4851-8ab9-5d050b42be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:53 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Volume 87fa9269-42e8-4f9e-a2d6-350381c027b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fa9269-42e8-4f9e-a2d6-350381c027b7', 'volume_size': 1} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1691b9b7-d620-4df3-b5ee-e5bd99ed10fb,created_at=2026-09-28T16:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752099855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1691b9b7-d620-4df3-b5ee-e5bd99ed10fb,host='devstack@QuobyteHD#QuobyteHD',id=87fa9269-42e8-4f9e-a2d6-350381c027b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:53Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beb45572-3577-487a-a250-9b99e52410bc),volume_type_id=beb45572-3577-487a-a250-9b99e52410bc)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Creating volume 87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:53 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:53 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3" returned: 0 in 1.106s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:53 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 1073741824 Sep 28 18:19:53 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:53 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3 Sep 28 18:19:53 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:53 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2c358790-ea9d-43a3-9260-4a42e394d3e3" returned: 0 in 0.353s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-2c358790-ea9d-43a3-9260-4a42e394d3e3" released by "delete_volume" :: held 1.551s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created reservations ['c5fa369e-9851-4bb6-81a5-b2c134ee8a70', '7808257a-cf9d-4c9b-a06b-ebac6a3a495a', '80339c14-caa4-4573-9770-d2f18a10cc50', '952c2005-83c5-4d5f-b35d-056d86193717'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=157,cinder:INSERT=49,cinder:UPDATE=207,cinder:DELETE=13 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:54 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:54 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:54 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 1073741824" returned: 0 in 0.812s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:54 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 Sep 28 18:19:54 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:54 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.357s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Deleted volume successfully. Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0bcda4c-2396-4aee-9f24-2cb28d4714a7 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-2c358790-ea9d-43a3-9260-4a42e394d3e3-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-6c3c5c2c-1758-425b-9304-877beec8fb94-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-6c3c5c2c-1758-425b-9304-877beec8fb94-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:INSERT=47,cinder:UPDATE=223,cinder:SELECT=157,cinder:DELETE=19 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:54 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7" returned: 0 in 0.498s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "cinder-quobyte-6c3c5c2c-1758-425b-9304-877beec8fb94" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:54 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb828e06-3152-4851-8ab9-5d050b42be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fa9269-42e8-4f9e-a2d6-350381c027b7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14017da-9366-442d-b6c8-e0bb7b806860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-6c3c5c2c-1758-425b-9304-877beec8fb94" acquired by "delete_volume" :: waited 0.054s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:55 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Volume volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 (87fa9269-42e8-4f9e-a2d6-350381c027b7): created successfully Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14017da-9366-442d-b6c8-e0bb7b806860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (8caa50d8-2af3-40c2-bb52-5151ae32f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[07826d0b-ac4c-4bea-8413-2ac8d71be6fe]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-598649c9-84bc-45b0-bc25-7fa40a1db9fd tempest-GroupSnapshotsTest-1912329485 None] Created volume successfully. Sep 28 18:19:55 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 Sep 28 18:19:55 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:55 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94" returned: 0 in 0.540s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:55 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94 Sep 28 18:19:55 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:55 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c3c5c2c-1758-425b-9304-877beec8fb94" returned: 0 in 0.311s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-quobyte-6c3c5c2c-1758-425b-9304-877beec8fb94" released by "delete_volume" :: held 0.923s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Created reservations ['851df633-a160-4ee6-8218-dc4733a010d6', '9ca73a77-1573-4f70-b4bc-6c940ed6a5e5', '40278be0-7e18-438b-8e5f-7b9526593007', 'f02f5819-1153-4b75-8b63-247b2dc1f990'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:56 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:19:56 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] GroupSnapshot 49202a43-1e48-4161-9d79-c35e26577ffd: creating. Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Group snapshot 49202a43-1e48-4161-9d79-c35e26577ffd: creating. {{(pid=86981) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Creating offline snapshot 7d46dedc-540b-434d-8ae4-10765d8e89e8 of volume 87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[572a7677-29d1-4bcf-9d57-7ed5e97e9326]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:56 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.478s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Deleted volume successfully. Sep 28 18:19:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d57303ab-d697-495d-9a07-e7f110638a42 tempest-CreateVolumesFromSourceVolumeTest-1548692711 None] Lock "cinder-6c3c5c2c-1758-425b-9304-877beec8fb94-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:56 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 Sep 28 18:19:56 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:57 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7" returned: 0 in 0.653s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:57 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 1G Sep 28 18:19:57 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Flow 'volume_create_manager' (ccec6cbe-1201-48b1-a046-028c0a7b5f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fde265-7f57-4623-bb25-99dee55594a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fde265-7f57-4623-bb25-99dee55594a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1424083005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbe8438-ecb0-472d-a524-8da0c7cd64dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9298ba24bd964d288feb1efee94d0dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:57Z,use_quota=True,user_id='ea391944b3e042a1b6fcafee979fe7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4930c994-0ccd-4577-b377-0a0817f46efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4930c994-0ccd-4577-b377-0a0817f46efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad21dd4a-4125-4518-b5b4-c21516c3ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad21dd4a-4125-4518-b5b4-c21516c3ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdbe8438-ecb0-472d-a524-8da0c7cd64dc', 'volume_name': 'volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa1c762-f8b2-4500-812c-62158ecc9805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa1c762-f8b2-4500-812c-62158ecc9805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da11fda2-2637-4af6-b221-2af026e54a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Volume cdbe8438-ecb0-472d-a524-8da0c7cd64dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc', 'volume_size': 1} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:57 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 1G" returned: 0 in 0.659s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:57 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 Sep 28 18:19:57 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:58 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8" returned: 0 in 0.501s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:58 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:19:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:58 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 Sep 28 18:19:58 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:58 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8" returned: 0 in 0.363s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:58 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.info Sep 28 18:19:58 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:59 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.info" returned: 0 in 0.476s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:59 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:59 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.info Sep 28 18:19:59 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:59 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.info" returned: 0 in 0.375s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.191s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.098s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1424083005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbe8438-ecb0-472d-a524-8da0c7cd64dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9298ba24bd964d288feb1efee94d0dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:57Z,use_quota=True,user_id='ea391944b3e042a1b6fcafee979fe7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Creating volume cdbe8438-ecb0-472d-a524-8da0c7cd64dc {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:59 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:19:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:59 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc 1073741824 Sep 28 18:19:59 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:59 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-de0a9df9-fa90-4efe-a07e-88bf24600cf1 tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 49202a43-1e48-4161-9d79-c35e26577ffd: created successfully Sep 28 18:20:00 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc 1073741824" returned: 0 in 0.668s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:00 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc Sep 28 18:20:00 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:00 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc" returned: 0 in 0.428s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da11fda2-2637-4af6-b221-2af026e54a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2865fc04-e187-4aaa-9744-8a664b0097f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Volume volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc (cdbe8438-ecb0-472d-a524-8da0c7cd64dc): created successfully Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2865fc04-e187-4aaa-9744-8a664b0097f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Flow 'volume_create_manager' (ccec6cbe-1201-48b1-a046-028c0a7b5f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-62c36439-11a5-43ae-9ea0-7e326f5f7cf2 tempest-VolumesServicesTestJSON-731345799 None] Created volume successfully. Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-7d46dedc-540b-434d-8ae4-10765d8e89e8-bbca0466-5f9f-40b2-a99f-2972b378adc9" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-7d46dedc-540b-434d-8ae4-10765d8e89e8-bbca0466-5f9f-40b2-a99f-2972b378adc9" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Creating volume bbca0466-5f9f-40b2-a99f-2972b378adc9 from snapshot 7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-bbca0466-5f9f-40b2-a99f-2972b378adc9" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-bbca0466-5f9f-40b2-a99f-2972b378adc9" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] snapshot: 7d46dedc-540b-434d-8ae4-10765d8e89e8, volume: bbca0466-5f9f-40b2-a99f-2972b378adc9, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Acquiring lock "cinder-cdbe8438-ecb0-472d-a524-8da0c7cd64dc-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6613de12-fbe4-4ece-93b9-dc49121203a7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Lock "cinder-cdbe8438-ecb0-472d-a524-8da0c7cd64dc-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Acquiring lock "cinder-quobyte-cdbe8438-ecb0-472d-a524-8da0c7cd64dc" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Lock "cinder-quobyte-cdbe8438-ecb0-472d-a524-8da0c7cd64dc" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689e062-0e74-43c9-a020-2d4e43411db3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 Sep 28 18:20:02 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:02 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc Sep 28 18:20:02 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:02 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8" returned: 0 in 0.565s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87fa9269-42e8-4f9e-a2d6-350381c027b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0c5d5b-3924-4be1-8df9-40d415fdf055]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc" returned: 0 in 0.470s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc Sep 28 18:20:02 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:02 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 Sep 28 18:20:02 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:03 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cdbe8438-ecb0-472d-a524-8da0c7cd64dc" returned: 0 in 0.527s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Lock "cinder-quobyte-cdbe8438-ecb0-472d-a524-8da0c7cd64dc" released by "delete_volume" :: held 1.071s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Created reservations ['f751483c-2304-483f-862d-9e08e8a687d6', 'b232d46a-0c65-42fa-bc58-da5e44b16acf', '62a7613d-6a38-4219-ad2d-4257c6865a39', '739e5188-0994-40bf-a3fb-6c7a8650ad28'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:03 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7" returned: 0 in 0.766s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:03 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 Sep 28 18:20:03 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:03 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:03 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:04 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.419s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:04 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Deleted volume successfully. Sep 28 18:20:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4a89ef95-0679-41b8-9fe5-3d5d82cc34f4 tempest-VolumesServicesTestJSON-731345799 None] Lock "cinder-cdbe8438-ecb0-472d-a524-8da0c7cd64dc-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Flow 'volume_create_manager' (45b0299c-f1ff-4daf-ac28-a502d282731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f06ddf-fdd0-4517-9b28-5f9a666827a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f06ddf-fdd0-4517-9b28-5f9a666827a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f958b3-d47e-4f54-977e-e9b2553a9bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb8c84437af4da690a6bf78c3cb502f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:08Z,use_quota=True,user_id='4897f27184bb4995bc149608157567d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99869f0-e115-4c72-9525-a5d04fc23c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99869f0-e115-4c72-9525-a5d04fc23c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53b798d-5848-4c91-9ce2-379a1e3bd745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:08 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:20:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53b798d-5848-4c91-9ce2-379a1e3bd745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31f958b3-d47e-4f54-977e-e9b2553a9bcf', 'volume_name': 'volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf', 'volume_size': 1, 'image_id': 'ebe32443-162e-41c1-880b-b98234c1f44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebe32443-162e-41c1-880b-b98234c1f44e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f7373d38abb0281f204f6d5cfe3a4c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eb8c84437af4da690a6bf78c3cb502f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75493b4cf9436a76c9d740ff7cfadcfe90e04b29581f0619467a43cfda9c881eed3838daa7f468827cc9fa9a0038df5cde8bdc76d1d8fd5b801020000aa7e85d', 'id': 'ebe32443-162e-41c1-880b-b98234c1f44e', 'created_at': datetime.datetime(2026, 9, 28, 16, 20, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 20, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebe32443-162e-41c1-880b-b98234c1f44e/file', 'properties': {}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373c06c7-a839-4bdd-98f5-c307a0e37e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373c06c7-a839-4bdd-98f5-c307a0e37e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59904cee-654e-4412-8159-5abb3431acb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:09 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Volume 31f958b3-d47e-4f54-977e-e9b2553a9bcf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf', 'volume_size': 1, 'image_id': 'ebe32443-162e-41c1-880b-b98234c1f44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebe32443-162e-41c1-880b-b98234c1f44e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f7373d38abb0281f204f6d5cfe3a4c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eb8c84437af4da690a6bf78c3cb502f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75493b4cf9436a76c9d740ff7cfadcfe90e04b29581f0619467a43cfda9c881eed3838daa7f468827cc9fa9a0038df5cde8bdc76d1d8fd5b801020000aa7e85d', 'id': 'ebe32443-162e-41c1-880b-b98234c1f44e', 'created_at': datetime.datetime(2026, 9, 28, 16, 20, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 20, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebe32443-162e-41c1-880b-b98234c1f44e/file', 'properties': {}}, 'image_service': } Sep 28 18:20:09 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Trying to clone 31f958b3-d47e-4f54-977e-e9b2553a9bcf from image ebe32443-162e-41c1-880b-b98234c1f44e at location (None, [{'url': 'file:///opt/stack/data/glance/images/ebe32443-162e-41c1-880b-b98234c1f44e', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:20:10 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:20:10 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:20:10 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fed541-a0b8-4ee4-b2c2-1cadd8d62896]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:10 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD Sep 28 18:20:10 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:11 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD" returned: 0 in 0.982s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:11 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD Sep 28 18:20:11 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:12 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD" returned: 1 in 1.149s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:20:12 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Temporary image ebe32443-162e-41c1-880b-b98234c1f44e is fetched for user 4897f27184bb4995bc149608157567d1. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:20:12 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bdfbc6-56e7-403a-8ff0-ea1067fc0720]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:13 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD Sep 28 18:20:13 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:13 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:13 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD Sep 28 18:20:13 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:13 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9" returned: 0 in 10.282s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:13 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7, size 1024.00 MB, duration 10.28 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:13 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Converted 1024.00 MB image at 99.57 MB/s Sep 28 18:20:13 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:20:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:13 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 Sep 28 18:20:13 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:14 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD" returned: 1 in 0.618s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:14 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9" returned: 0 in 0.426s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-bbca0466-5f9f-40b2-a99f-2972b378adc9" released by "_copy_volume_from_snapshot" :: held 12.214s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-7d46dedc-540b-434d-8ae4-10765d8e89e8-bbca0466-5f9f-40b2-a99f-2972b378adc9" released by "_create_volume_from_snapshot" :: held 12.336s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.381s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.181s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f958b3-d47e-4f54-977e-e9b2553a9bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb8c84437af4da690a6bf78c3cb502f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:08Z,use_quota=True,user_id='4897f27184bb4995bc149608157567d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Creating volume 31f958b3-d47e-4f54-977e-e9b2553a9bcf {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:14 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:14 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf 1073741824 Sep 28 18:20:14 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-584d45ac-6faa-4f78-9f7c-bd5cb3f17875 tempest-GroupSnapshotsTest-1912329485 None] Create group from source-snapshot-49202a43-1e48-4161-9d79-c35e26577ffd completed successfully. Sep 28 18:20:15 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf 1073741824" returned: 0 in 0.723s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:15 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf Sep 28 18:20:15 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:15 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf" returned: 0 in 0.364s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Attempting download of ebe32443-162e-41c1-880b-b98234c1f44e ((None, [{'url': 'file:///opt/stack/data/glance/images/ebe32443-162e-41c1-880b-b98234c1f44e', 'metadata': {}}])) to volume 31f958b3-d47e-4f54-977e-e9b2553a9bcf. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f7db0d-a772-4f83-a8bf-7a43e68c5574]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebe32443-162e-41c1-880b-b98234c1f44e_nchd01hx {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:15 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebe32443-162e-41c1-880b-b98234c1f44e_nchd01hx Sep 28 18:20:15 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-bbca0466-5f9f-40b2-a99f-2972b378adc9" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-bbca0466-5f9f-40b2-a99f-2972b378adc9" acquired by "delete_volume" :: waited 0.049s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc556ad-d36e-489b-8af8-1662f504c559]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 Sep 28 18:20:16 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebe32443-162e-41c1-880b-b98234c1f44e_nchd01hx" returned: 0 in 0.522s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebe32443-162e-41c1-880b-b98234c1f44e_nchd01hx {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebe32443-162e-41c1-880b-b98234c1f44e_nchd01hx Sep 28 18:20:16 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9" returned: 0 in 0.626s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9 Sep 28 18:20:16 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebe32443-162e-41c1-880b-b98234c1f44e_nchd01hx" returned: 1 in 0.552s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebe32443-162e-41c1-880b-b98234c1f44e_nchd01hx' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0215ea-eb39-4a01-a068-7a44cd382d0a]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD Sep 28 18:20:16 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-bbca0466-5f9f-40b2-a99f-2972b378adc9" returned: 0 in 0.349s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-bbca0466-5f9f-40b2-a99f-2972b378adc9" released by "delete_volume" :: held 1.068s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['52f03cc9-b65c-4866-944c-c4fa688ec222'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:17 devstack cinder-volume[86981]: WARNING cinder.quota [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-368246570 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-368246570, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:17 devstack cinder-volume[86981]: WARNING cinder.quota [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-368246570 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-368246570, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:17 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['df79e096-f06e-495b-ae2d-2f0c758b1670', '42e258ce-ce14-4125-a530-eff0bfd610f9', '636e2a9e-4bb8-496a-a0ca-78fe7b9d060b', '1c64f84a-c801-4635-846e-1fa5d0ae5324'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:17 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD Sep 28 18:20:17 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:17 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:17 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:17 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD" returned: 1 in 0.520s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] ebe32443-162e-41c1-880b-b98234c1f44e was raw, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:17 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf Sep 28 18:20:17 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:17 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.301s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:17 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b840309b-0bda-4012-a746-9d1710243400 tempest-GroupSnapshotsTest-1912329485 None] Delete group completed successfully. Sep 28 18:20:18 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf" returned: 0 in 0.751s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ebe32443-162e-41c1-880b-b98234c1f44e_ht4e5vtpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:18 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:18 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf 1G Sep 28 18:20:18 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Flow 'volume_create_manager' (0a2ebb95-8382-4f18-b69f-494a443e406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1bf99b-77c8-4700-a10d-49939ec3697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 49202a43-1e48-4161-9d79-c35e26577ffd: deleting Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1bf99b-77c8-4700-a10d-49939ec3697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1542204783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b17b290-48bb-4630-a3d3-f54d9d3b61e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aee75b6cf294c9981c45acdfbc75dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:19Z,use_quota=True,user_id='9625cfe6bb1849a28740b315230506bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88459f4f-111a-48e3-917b-611399214d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88459f4f-111a-48e3-917b-611399214d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e1cbbf-ae6c-4992-bc36-15bf092f6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e1cbbf-ae6c-4992-bc36-15bf092f6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b17b290-48bb-4630-a3d3-f54d9d3b61e7', 'volume_name': 'volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ffa971-c521-4a3c-a700-afb3b17da197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ffa971-c521-4a3c-a700-afb3b17da197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a9e397-b2c5-4afc-b263-2f03179ccc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:18 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Volume 9b17b290-48bb-4630-a3d3-f54d9d3b61e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7', 'volume_size': 1} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1542204783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b17b290-48bb-4630-a3d3-f54d9d3b61e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aee75b6cf294c9981c45acdfbc75dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:19Z,use_quota=True,user_id='9625cfe6bb1849a28740b315230506bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Creating volume 9b17b290-48bb-4630-a3d3-f54d9d3b61e7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:18 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 49202a43-1e48-4161-9d79-c35e26577ffd: deleting {{(pid=86981) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:20:18 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 1073741824 Sep 28 18:20:18 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-87fa9269-42e8-4f9e-a2d6-350381c027b7" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-87fa9269-42e8-4f9e-a2d6-350381c027b7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-7d46dedc-540b-434d-8ae4-10765d8e89e8" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-7d46dedc-540b-434d-8ae4-10765d8e89e8" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Deleting offline snapshot 7d46dedc-540b-434d-8ae4-10765d8e89e8 of volume 87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] snapshot_file for this snap is: volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d8851-713d-4bb9-921e-ea954514fc17]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:19 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf 1G" returned: 0 in 0.693s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Downloaded image ebe32443-162e-41c1-880b-b98234c1f44e ((None, [{'url': 'file:///opt/stack/data/glance/images/ebe32443-162e-41c1-880b-b98234c1f44e', 'metadata': {}}])) to volume 31f958b3-d47e-4f54-977e-e9b2553a9bcf successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Temporary image ebe32443-162e-41c1-880b-b98234c1f44e for user 4897f27184bb4995bc149608157567d1 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Marking volume 31f958b3-d47e-4f54-977e-e9b2553a9bcf as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Copying metadata from image ebe32443-162e-41c1-880b-b98234c1f44e to 31f958b3-d47e-4f54-977e-e9b2553a9bcf. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Creating volume glance metadata for volume 31f958b3-d47e-4f54-977e-e9b2553a9bcf backed by image ebe32443-162e-41c1-880b-b98234c1f44e with: {'image_id': 'ebe32443-162e-41c1-880b-b98234c1f44e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1f7373d38abb0281f204f6d5cfe3a4c6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:20:19 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59904cee-654e-4412-8159-5abb3431acb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf', 'volume_size': 1, 'image_id': 'ebe32443-162e-41c1-880b-b98234c1f44e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebe32443-162e-41c1-880b-b98234c1f44e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f7373d38abb0281f204f6d5cfe3a4c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eb8c84437af4da690a6bf78c3cb502f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75493b4cf9436a76c9d740ff7cfadcfe90e04b29581f0619467a43cfda9c881eed3838daa7f468827cc9fa9a0038df5cde8bdc76d1d8fd5b801020000aa7e85d', 'id': 'ebe32443-162e-41c1-880b-b98234c1f44e', 'created_at': datetime.datetime(2026, 9, 28, 16, 20, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 20, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebe32443-162e-41c1-880b-b98234c1f44e/file', 'properties': {}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:19 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1da9868-7162-4999-98ef-3905478792bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Volume volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf (31f958b3-d47e-4f54-977e-e9b2553a9bcf): created successfully Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1da9868-7162-4999-98ef-3905478792bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Flow 'volume_create_manager' (45b0299c-f1ff-4daf-ac28-a502d282731b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7748c11e-d534-48fd-896b-87c3afebda39 tempest-VolumeImageDependencyTests-237917381 None] Created volume successfully. Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Flow 'volume_create_manager' (81038a46-3cfa-4e3d-9227-eda7a5c5e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d94a06-a6bb-42cb-a185-56f974c5d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:19 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d94a06-a6bb-42cb-a185-56f974c5d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2123314299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aee75b6cf294c9981c45acdfbc75dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:20Z,use_quota=True,user_id='9625cfe6bb1849a28740b315230506bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed729fc3-fc2f-4739-a14d-967729967ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed729fc3-fc2f-4739-a14d-967729967ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068f91fc-e5be-4a0c-a235-453b2c47191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068f91fc-e5be-4a0c-a235-453b2c47191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0', 'volume_name': 'volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce65e85-cc92-43ba-956e-7972328bc01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce65e85-cc92-43ba-956e-7972328bc01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d5b6e7-cb5b-47ce-a9fe-f188bdb40da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Volume 7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0', 'volume_size': 1} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8" returned: 0 in 0.775s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87fa9269-42e8-4f9e-a2d6-350381c027b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:19 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Acquiring lock "cinder-31f958b3-d47e-4f54-977e-e9b2553a9bcf-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 1073741824" returned: 0 in 1.099s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6da1fe-57ce-4199-bdc3-1eb4c49cd9ef]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Lock "cinder-31f958b3-d47e-4f54-977e-e9b2553a9bcf-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Acquiring lock "cinder-quobyte-31f958b3-d47e-4f54-977e-e9b2553a9bcf" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Lock "cinder-quobyte-31f958b3-d47e-4f54-977e-e9b2553a9bcf" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:20 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 Sep 28 18:20:20 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3258b40-01e4-4707-ade8-8abb8897b018]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 Sep 28 18:20:20 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf Sep 28 18:20:20 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7" returned: 0 in 0.698s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2123314299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aee75b6cf294c9981c45acdfbc75dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:20Z,use_quota=True,user_id='9625cfe6bb1849a28740b315230506bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Creating volume 7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:20 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 1073741824 Sep 28 18:20:20 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a9e397-b2c5-4afc-b263-2f03179ccc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feb67a3-1607-4eb6-94ab-a3a94dabdda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:20 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf" returned: 0 in 0.739s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Volume volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 (9b17b290-48bb-4630-a3d3-f54d9d3b61e7): created successfully Sep 28 18:20:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feb67a3-1607-4eb6-94ab-a3a94dabdda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:20 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf Sep 28 18:20:21 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Flow 'volume_create_manager' (0a2ebb95-8382-4f18-b69f-494a443e406d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-aae4e531-6b6b-45d6-8ced-7fe5f18a6cb5 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Created volume successfully. Sep 28 18:20:21 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7" returned: 0 in 1.397s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:21 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 Sep 28 18:20:21 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:21 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-31f958b3-d47e-4f54-977e-e9b2553a9bcf" returned: 0 in 0.661s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Lock "cinder-quobyte-31f958b3-d47e-4f54-977e-e9b2553a9bcf" released by "delete_volume" :: held 1.508s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Created reservations ['a4b14779-e7d8-4556-a31d-b09bb1b66638', '3e68bede-1e6f-4cf3-9139-6198161b2694', '259c8adc-58be-4791-81dd-15f04fe27bc6', '487ad3e5-fe01-4da9-92c7-12403aad8f86'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:21 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 1073741824" returned: 0 in 1.162s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:21 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:21 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:22 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8" returned: 0 in 0.717s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:22 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 Sep 28 18:20:22 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:22 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8 Sep 28 18:20:22 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:22 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.523s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Deleted volume successfully. Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-cdad04bc-04c2-4409-84df-a1cbe567571c tempest-VolumeImageDependencyTests-237917381 None] Lock "cinder-31f958b3-d47e-4f54-977e-e9b2553a9bcf-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:22 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7.7d46dedc-540b-434d-8ae4-10765d8e89e8" returned: 0 in 0.550s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:22 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0" returned: 0 in 0.638s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-7d46dedc-540b-434d-8ae4-10765d8e89e8" released by "_delete_snapshot" :: held 3.700s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-87fa9269-42e8-4f9e-a2d6-350381c027b7" released by "delete_snapshot" :: held 3.759s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d5b6e7-cb5b-47ce-a9fe-f188bdb40da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f041c84-7c6e-4489-b037-31342a62b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:22 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Volume volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 (7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0): created successfully Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f041c84-7c6e-4489-b037-31342a62b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Flow 'volume_create_manager' (81038a46-3cfa-4e3d-9227-eda7a5c5e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-34233e63-0a84-4c21-b153-d03281153583 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Created volume successfully. Sep 28 18:20:22 devstack cinder-volume[86981]: WARNING cinder.quota [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-368246570 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-368246570, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:23 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['0362febc-880c-45a1-b805-5b77ee71dee1', '8d0afe62-94b0-4e7f-bd46-acb5425405ab', 'b31200c0-be37-40e5-b736-52b371f73c68', '2c63ded1-a843-46b5-b7ff-2bd70dec0f3e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-99ee3532-014d-4f4f-8b00-e97b335b4c5e tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 49202a43-1e48-4161-9d79-c35e26577ffd: deleted successfully Sep 28 18:20:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-87fa9269-42e8-4f9e-a2d6-350381c027b7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-87fa9269-42e8-4f9e-a2d6-350381c027b7" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:23 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cb8e98-77aa-4224-a182-90e661b2d555]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:24 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 Sep 28 18:20:24 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:24 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7" returned: 0 in 0.571s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:24 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7 Sep 28 18:20:24 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:24 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87fa9269-42e8-4f9e-a2d6-350381c027b7" returned: 0 in 0.434s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-87fa9269-42e8-4f9e-a2d6-350381c027b7" released by "delete_volume" :: held 1.114s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['73d2c477-ebf7-45c7-91a9-95eef1736f6e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:25 devstack cinder-volume[86981]: WARNING cinder.db.api [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-368246570'] Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['73ed7758-d75e-4b3b-8ed0-7670c91f1269', '86c1a293-4e8d-4921-995a-61ac4e73abc6', 'a1f455cc-6fc5-4db6-af23-a3080eb4ec7f', '87e4284a-bbe0-46c9-a03a-cf9273f5c919'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:25 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:25 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:25 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:25 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-40f895c4-1b9c-443d-8c81-13587035bcd5 tempest-GroupSnapshotsTest-1912329485 None] Delete group completed successfully. Sep 28 18:20:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9215afd8-82e9-4d0c-bdb1-a13a0a97d9e0 tempest-GroupSnapshotsTest-1912329485 None] Group tempest-GroupSnapshotsTest-Group-464783266: creating Sep 28 18:20:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9215afd8-82e9-4d0c-bdb1-a13a0a97d9e0 tempest-GroupSnapshotsTest-1912329485 None] Group tempest-GroupSnapshotsTest-Group-464783266: created successfully Sep 28 18:20:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9215afd8-82e9-4d0c-bdb1-a13a0a97d9e0 tempest-GroupSnapshotsTest-1912329485 None] Create group completed successfully. Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (1ffd536a-3dae-4775-b2be-75109604fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381cff93-2aca-42d8-a475-d8f2febafb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381cff93-2aca-42d8-a475-d8f2febafb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177621847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0b79338-df71-4ee3-ae2a-0d82655f04a7,host='devstack@QuobyteHD#QuobyteHD',id=e7832a36-f487-4349-bec2-d38aa3812fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:29Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a402a877-5a85-4e67-a778-d30750315d76),volume_type_id=a402a877-5a85-4e67-a778-d30750315d76)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01695de7-a8b3-4425-925c-a924a79220ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01695de7-a8b3-4425-925c-a924a79220ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb7bf1e-b8e3-4a54-88a5-9fbf0369ee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb7bf1e-b8e3-4a54-88a5-9fbf0369ee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7832a36-f487-4349-bec2-d38aa3812fdb', 'volume_name': 'volume-e7832a36-f487-4349-bec2-d38aa3812fdb', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f3b25a-2a94-4b42-a1a4-5224c168cb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f3b25a-2a94-4b42-a1a4-5224c168cb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610aec44-a2ba-4b99-9bdc-56002b206b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Volume e7832a36-f487-4349-bec2-d38aa3812fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7832a36-f487-4349-bec2-d38aa3812fdb', 'volume_size': 1} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0b79338-df71-4ee3-ae2a-0d82655f04a7,created_at=2026-09-28T16:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177621847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0b79338-df71-4ee3-ae2a-0d82655f04a7,host='devstack@QuobyteHD#QuobyteHD',id=e7832a36-f487-4349-bec2-d38aa3812fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:29Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a402a877-5a85-4e67-a778-d30750315d76),volume_type_id=a402a877-5a85-4e67-a778-d30750315d76)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Creating volume e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:29 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:29 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb 1073741824 Sep 28 18:20:29 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (01d059e0-6d83-4e99-8976-97799ed9cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2923ab55-0ef0-4579-b7d8-e61659b66ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2923ab55-0ef0-4579-b7d8-e61659b66ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387796577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958ab8d1-f6b9-4143-b278-37b198c8ffab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:30Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7818c5-d99f-464f-a050-89d8c7b71c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7818c5-d99f-464f-a050-89d8c7b71c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3800694b-33fc-48a1-b155-a5f0321865f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3800694b-33fc-48a1-b155-a5f0321865f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958ab8d1-f6b9-4143-b278-37b198c8ffab', 'volume_name': 'volume-958ab8d1-f6b9-4143-b278-37b198c8ffab', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad04d72-37c8-402e-bb8d-65bf9161293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad04d72-37c8-402e-bb8d-65bf9161293f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76840a7-f97c-4c7f-a302-368df791dab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:30 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Volume 958ab8d1-f6b9-4143-b278-37b198c8ffab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958ab8d1-f6b9-4143-b278-37b198c8ffab', 'volume_size': 1} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:30 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb 1073741824" returned: 0 in 0.952s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:30 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb Sep 28 18:20:30 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:30 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb" returned: 0 in 0.330s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387796577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958ab8d1-f6b9-4143-b278-37b198c8ffab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:30Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Creating volume 958ab8d1-f6b9-4143-b278-37b198c8ffab {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:30 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:30 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab 1073741824 Sep 28 18:20:30 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610aec44-a2ba-4b99-9bdc-56002b206b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7832a36-f487-4349-bec2-d38aa3812fdb', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5c13cb-f76a-43e0-bda4-1f6019dac874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:30 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Volume volume-e7832a36-f487-4349-bec2-d38aa3812fdb (e7832a36-f487-4349-bec2-d38aa3812fdb): created successfully Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5c13cb-f76a-43e0-bda4-1f6019dac874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (1ffd536a-3dae-4775-b2be-75109604fff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4e9f6d9f-1fd4-41c1-8ee5-f886b4e00608 tempest-GroupSnapshotsTest-1912329485 None] Created volume successfully. Sep 28 18:20:31 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab 1073741824" returned: 0 in 0.761s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:31 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab Sep 28 18:20:31 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab" returned: 0 in 0.486s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:32 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76840a7-f97c-4c7f-a302-368df791dab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958ab8d1-f6b9-4143-b278-37b198c8ffab', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3bfa96-8f8b-4290-8c26-d6498ba48536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:32 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Volume volume-958ab8d1-f6b9-4143-b278-37b198c8ffab (958ab8d1-f6b9-4143-b278-37b198c8ffab): created successfully Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3bfa96-8f8b-4290-8c26-d6498ba48536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (01d059e0-6d83-4e99-8976-97799ed9cac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:32 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5b82f221-0938-4ffd-ac47-e4704d27987d tempest-ProjectReaderTests-1669226618 None] Created volume successfully. Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (c119c315-1744-4059-b9c7-d22c39317415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671978ad-6fb3-4db3-bd59-fb659e4808dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671978ad-6fb3-4db3-bd59-fb659e4808dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120406863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0b79338-df71-4ee3-ae2a-0d82655f04a7,host='devstack@QuobyteHD#QuobyteHD',id=db6bd8df-f755-40da-9640-b6d6144e1346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:33Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a402a877-5a85-4e67-a778-d30750315d76),volume_type_id=a402a877-5a85-4e67-a778-d30750315d76)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f807bafb-6059-489a-a34c-b96acca0d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f807bafb-6059-489a-a34c-b96acca0d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a1682a-e8b9-4a7c-960b-04c482d58829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a1682a-e8b9-4a7c-960b-04c482d58829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6bd8df-f755-40da-9640-b6d6144e1346', 'volume_name': 'volume-db6bd8df-f755-40da-9640-b6d6144e1346', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31041df9-ab1a-47a9-8d7a-5415871bb335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31041df9-ab1a-47a9-8d7a-5415871bb335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34d0955-d5b2-4427-bf0e-288b5ce7c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:32 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Volume db6bd8df-f755-40da-9640-b6d6144e1346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6bd8df-f755-40da-9640-b6d6144e1346', 'volume_size': 1} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0b79338-df71-4ee3-ae2a-0d82655f04a7,created_at=2026-09-28T16:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120406863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0b79338-df71-4ee3-ae2a-0d82655f04a7,host='devstack@QuobyteHD#QuobyteHD',id=db6bd8df-f755-40da-9640-b6d6144e1346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:33Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a402a877-5a85-4e67-a778-d30750315d76),volume_type_id=a402a877-5a85-4e67-a778-d30750315d76)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Creating volume db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:32 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:33 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 1073741824 Sep 28 18:20:33 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-958ab8d1-f6b9-4143-b278-37b198c8ffab-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:33 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 1073741824" returned: 0 in 0.961s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-958ab8d1-f6b9-4143-b278-37b198c8ffab-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-quobyte-958ab8d1-f6b9-4143-b278-37b198c8ffab" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:34 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 Sep 28 18:20:34 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-958ab8d1-f6b9-4143-b278-37b198c8ffab" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c10f3-8b73-44c3-aae6-285cf794c842]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab Sep 28 18:20:34 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:34 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346" returned: 0 in 0.559s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34d0955-d5b2-4427-bf0e-288b5ce7c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6bd8df-f755-40da-9640-b6d6144e1346', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf92ce06-6df0-4563-bc4d-899eebca930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:34 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Volume volume-db6bd8df-f755-40da-9640-b6d6144e1346 (db6bd8df-f755-40da-9640-b6d6144e1346): created successfully Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf92ce06-6df0-4563-bc4d-899eebca930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (c119c315-1744-4059-b9c7-d22c39317415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:34 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6ade1e31-6577-4557-b168-9a8d2753e499 tempest-GroupSnapshotsTest-1912329485 None] Created volume successfully. Sep 28 18:20:34 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab" returned: 0 in 0.577s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab Sep 28 18:20:34 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:35 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-958ab8d1-f6b9-4143-b278-37b198c8ffab" returned: 0 in 0.451s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-958ab8d1-f6b9-4143-b278-37b198c8ffab" released by "delete_volume" :: held 1.125s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Created reservations ['65a63de3-65e1-46ab-a691-77cee591e60b', '5ec1e67e-9ea2-423d-a119-3c6a11ae974c', 'c7aee134-b438-4fe8-acba-803118aaefc2', 'b30264e6-72fe-4770-9f24-5d8484421811'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:35 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:35 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:35 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.414s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:35 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Deleted volume successfully. Sep 28 18:20:36 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6d760419-77f6-42a3-84ca-55ffabc595aa tempest-GroupSnapshotsTest-1912329485 None] Update group completed successfully. Sep 28 18:20:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b96602a0-9ade-42e6-b8b6-bc857495ac13 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-958ab8d1-f6b9-4143-b278-37b198c8ffab-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (b5264409-cbaa-4218-9c78-17812573e2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dd091f-909e-4e80-849a-2d8ad9630fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dd091f-909e-4e80-849a-2d8ad9630fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470807316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:37Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a351042-91fb-46d8-a965-37d3b71b5380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a351042-91fb-46d8-a965-37d3b71b5380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ad2688-ca9c-4772-adb7-c12f087dcb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ad2688-ca9c-4772-adb7-c12f087dcb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5', 'volume_name': 'volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b37983-a596-4863-b86f-0091531a09ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b37983-a596-4863-b86f-0091531a09ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423b4295-01bb-4134-aaf2-6d15b9da38dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:37 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Volume 9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5', 'volume_size': 1} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470807316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:37Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Creating volume 9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:37 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:37 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 1073741824 Sep 28 18:20:37 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c3056c85-2ffd-4d9b-858b-1e76e2ee4dfe tempest-GroupSnapshotsTest-1912329485 None] Update group completed successfully. Sep 28 18:20:37 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 1073741824" returned: 0 in 0.690s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:37 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 Sep 28 18:20:37 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:38 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5" returned: 0 in 0.296s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423b4295-01bb-4134-aaf2-6d15b9da38dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8221091e-8ce5-4116-994f-1a459401cb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:38 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Volume volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 (9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5): created successfully Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8221091e-8ce5-4116-994f-1a459401cb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (b5264409-cbaa-4218-9c78-17812573e2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-361dbf9e-ed77-4575-8b45-f1cfa4dacf2a tempest-ProjectReaderTests-1669226618 None] Created volume successfully. Sep 28 18:20:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-619c145c-983c-49f5-961a-02abc2075bd0 tempest-GroupSnapshotsTest-1912329485 None] Update group completed successfully. Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:38 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:38 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:39 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.544s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-quobyte-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8683a76-6f6a-4c42-9302-dc7e031f9d2e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:39 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-722dc46d-2e29-420c-ab5a-b67adf2c1efb tempest-GroupSnapshotsTest-1912329485 None] Update group completed successfully. Sep 28 18:20:39 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 Sep 28 18:20:39 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:40 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5" returned: 0 in 0.563s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:40 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5 Sep 28 18:20:40 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:40 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5" returned: 0 in 0.325s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5" released by "delete_volume" :: held 0.974s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Created reservations ['116b4347-371f-4b0e-af62-3660ea73e001', 'f108cccd-5627-4558-909c-7108723dbd53', 'bc872a00-c1bc-45c8-8e96-47c53e8a6dc5', '05a65579-d587-41a2-b998-d97eff8a7279'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:40 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:40 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:41 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.380s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Deleted volume successfully. Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5d670aa7-c4ae-4a5b-9083-ba4fa9ea3945 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-9d36c52a-ea48-48f3-b9bf-5bdd1ccf19d5-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] GroupSnapshot fbe96ccd-7b8c-408a-8815-f8c25b177586: creating. Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Group snapshot fbe96ccd-7b8c-408a-8815-f8c25b177586: creating. {{(pid=86981) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Creating offline snapshot 07377078-f268-43cc-9387-e3fbebb24c08 of volume e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1132e107-405c-44b7-b0c4-a3673eba1ec9]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:41 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb Sep 28 18:20:41 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:42 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb" returned: 0 in 0.530s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:42 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 1G Sep 28 18:20:42 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (64ff5df8-c8fb-48cf-b305-5d60894a577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c43c4f-a095-4e94-96c8-8746ea58a071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:42 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c43c4f-a095-4e94-96c8-8746ea58a071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-251487676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b9f3e8-8aa0-4dcb-9912-26973a732d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:43Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708dfec8-6a2d-47db-bc3f-4e734af9f494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708dfec8-6a2d-47db-bc3f-4e734af9f494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039219ee-3d24-4fdc-85de-040c5a5ef4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039219ee-3d24-4fdc-85de-040c5a5ef4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b9f3e8-8aa0-4dcb-9912-26973a732d95', 'volume_name': 'volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b7db62-4078-4610-8ecf-1ef5874cd319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b7db62-4078-4610-8ecf-1ef5874cd319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c00fca8-ff69-4f37-b3c8-11f0d5a5a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:42 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Volume 28b9f3e8-8aa0-4dcb-9912-26973a732d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95', 'volume_size': 1} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 1G" returned: 0 in 0.732s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7832a36-f487-4349-bec2-d38aa3812fdb -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:42 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7832a36-f487-4349-bec2-d38aa3812fdb -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 Sep 28 18:20:42 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7832a36-f487-4349-bec2-d38aa3812fdb -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08" returned: 0 in 0.364s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:20:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 Sep 28 18:20:43 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08" returned: 0 in 0.315s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.info Sep 28 18:20:43 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.info" returned: 0 in 0.292s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:20:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.info Sep 28 18:20:43 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.info" returned: 0 in 0.305s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Creating offline snapshot d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 of volume db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fce4dd-2da3-4dc5-a134-fdda4532fe91]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 Sep 28 18:20:44 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346" returned: 0 in 0.485s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 1G Sep 28 18:20:44 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 1G" returned: 0 in 0.580s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6bd8df-f755-40da-9640-b6d6144e1346 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6bd8df-f755-40da-9640-b6d6144e1346 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 Sep 28 18:20:45 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6bd8df-f755-40da-9640-b6d6144e1346 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" returned: 0 in 0.364s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:20:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 Sep 28 18:20:45 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" returned: 0 in 0.317s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:46 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.info Sep 28 18:20:46 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:46 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.info" returned: 0 in 0.308s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:46 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.info Sep 28 18:20:46 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:46 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.info" returned: 0 in 0.420s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-251487676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b9f3e8-8aa0-4dcb-9912-26973a732d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:43Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Creating volume 28b9f3e8-8aa0-4dcb-9912-26973a732d95 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:46 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:46 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 1073741824 Sep 28 18:20:46 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:47 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fc6bbb8e-1398-4985-a112-e28f1fa08884 tempest-GroupSnapshotsTest-1912329485 None] group_snapshot fbe96ccd-7b8c-408a-8815-f8c25b177586: created successfully Sep 28 18:20:47 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 1073741824" returned: 0 in 0.634s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:47 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 Sep 28 18:20:47 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:47 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95" returned: 0 in 0.348s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c00fca8-ff69-4f37-b3c8-11f0d5a5a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5d4b48-c514-413a-b3c4-e55b139cf34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Volume volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 (28b9f3e8-8aa0-4dcb-9912-26973a732d95): created successfully Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5d4b48-c514-413a-b3c4-e55b139cf34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (64ff5df8-c8fb-48cf-b305-5d60894a577d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4aeb27bc-4d12-4bca-923f-0b4f93344f7e tempest-ProjectReaderTests-1669226618 None] Created volume successfully. Sep 28 18:20:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] group_snapshot fbe96ccd-7b8c-408a-8815-f8c25b177586: deleting Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] group_snapshot fbe96ccd-7b8c-408a-8815-f8c25b177586: deleting {{(pid=86981) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-e7832a36-f487-4349-bec2-d38aa3812fdb" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-e7832a36-f487-4349-bec2-d38aa3812fdb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-07377078-f268-43cc-9387-e3fbebb24c08" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-07377078-f268-43cc-9387-e3fbebb24c08" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Deleting offline snapshot 07377078-f268-43cc-9387-e3fbebb24c08 of volume e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] snapshot_file for this snap is: volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[637c59c3-b98c-48ef-8304-41a966f06c38]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:48 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 Sep 28 18:20:48 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:48 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08" returned: 0 in 0.546s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7832a36-f487-4349-bec2-d38aa3812fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0a7401-295c-4c2b-bfdc-5ea933d68da7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:49 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb Sep 28 18:20:49 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-28b9f3e8-8aa0-4dcb-9912-26973a732d95-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Lock "cinder-28b9f3e8-8aa0-4dcb-9912-26973a732d95-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-quobyte-28b9f3e8-8aa0-4dcb-9912-26973a732d95" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-28b9f3e8-8aa0-4dcb-9912-26973a732d95" acquired by "delete_volume" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b06a06-8f92-4bb1-81c0-ab287776c207]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:49 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb" returned: 0 in 0.743s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Flow 'volume_create_manager' (e63212c0-0569-42ae-999d-0840d01de95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:49 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 Sep 28 18:20:49 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765cc22d-2a97-4c4a-8a2c-7bd2ec77f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765cc22d-2a97-4c4a-8a2c-7bd2ec77f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-496495120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a925961-4c56-4a1f-b369-3e080d8f0994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3f42fa11c94a638bc4dce37a9e3bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:50Z,use_quota=True,user_id='6b5977e0a8ed4d74af2e62cea49d4915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516e0738-7d6b-436a-9ca6-711c8bc1495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:49 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 Sep 28 18:20:49 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516e0738-7d6b-436a-9ca6-711c8bc1495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544d5e03-d89f-4cd8-ae4a-3f62a8b10e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544d5e03-d89f-4cd8-ae4a-3f62a8b10e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a925961-4c56-4a1f-b369-3e080d8f0994', 'volume_name': 'volume-3a925961-4c56-4a1f-b369-3e080d8f0994', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8919a9-cb60-4f4d-8fa0-1be88763c432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8919a9-cb60-4f4d-8fa0-1be88763c432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c842a2-ee88-42c9-b308-3cfec8fa22ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:49 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Volume 3a925961-4c56-4a1f-b369-3e080d8f0994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a925961-4c56-4a1f-b369-3e080d8f0994', 'volume_size': 1} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-496495120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a925961-4c56-4a1f-b369-3e080d8f0994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3f42fa11c94a638bc4dce37a9e3bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:50Z,use_quota=True,user_id='6b5977e0a8ed4d74af2e62cea49d4915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Creating volume 3a925961-4c56-4a1f-b369-3e080d8f0994 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:49 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:49 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 1073741824 Sep 28 18:20:49 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:50 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95" returned: 0 in 0.562s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:50 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95 Sep 28 18:20:50 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:50 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08" returned: 0 in 0.525s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:50 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08 Sep 28 18:20:50 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:50 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 1073741824" returned: 0 in 0.577s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:50 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-28b9f3e8-8aa0-4dcb-9912-26973a732d95" returned: 0 in 0.336s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-28b9f3e8-8aa0-4dcb-9912-26973a732d95" released by "delete_volume" :: held 0.993s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:50 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb.07377078-f268-43cc-9387-e3fbebb24c08" returned: 0 in 0.346s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:50 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 Sep 28 18:20:50 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-07377078-f268-43cc-9387-e3fbebb24c08" released by "_delete_snapshot" :: held 2.342s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-e7832a36-f487-4349-bec2-d38aa3812fdb" released by "delete_snapshot" :: held 2.383s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-db6bd8df-f755-40da-9640-b6d6144e1346" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Created reservations ['09e98ece-f283-49b5-bbc7-b840abf2dfd8', '10e8b051-6713-4aa1-a7e4-9d7f84fd4ee5', 'da0a7f8a-6dad-4d68-bb21-48db7e9874fb', '920b1ea9-6e7d-4cf4-b509-19d03d51e54b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-db6bd8df-f755-40da-9640-b6d6144e1346" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Deleting offline snapshot d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 of volume db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] snapshot_file for this snap is: volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e1cd2-077d-4567-aa00-3afd90362a4f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:50 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:50 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:50 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994" returned: 0 in 0.339s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c842a2-ee88-42c9-b308-3cfec8fa22ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a925961-4c56-4a1f-b369-3e080d8f0994', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b796c445-5173-4a26-ae04-2aa4c7da63f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:50 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 Sep 28 18:20:50 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:50 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Volume volume-3a925961-4c56-4a1f-b369-3e080d8f0994 (3a925961-4c56-4a1f-b369-3e080d8f0994): created successfully Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b796c445-5173-4a26-ae04-2aa4c7da63f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Flow 'volume_create_manager' (e63212c0-0569-42ae-999d-0840d01de95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b1af2925-ea9a-4b1f-8f98-7fb7ea6ea3a4 tempest-VolumesListAdminTestJSON-1663724221 None] Created volume successfully. Sep 28 18:20:51 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.318s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Deleted volume successfully. Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5618dfd2-70bd-434e-a554-41322081d0aa tempest-ProjectReaderTests-1669226618 None] Lock "cinder-28b9f3e8-8aa0-4dcb-9912-26973a732d95-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:51 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" returned: 0 in 0.497s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db6bd8df-f755-40da-9640-b6d6144e1346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d84779-0970-4dbf-9f80-e15898147ef1]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:51 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 Sep 28 18:20:51 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:51 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:51 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 Sep 28 18:20:51 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:52 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" returned: 0 in 0.500s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:52 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934 Sep 28 18:20:52 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:52 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346.d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" returned: 0 in 0.322s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-d35b547f-b8dd-4b40-ab8e-fff8d4d7b934" released by "_delete_snapshot" :: held 1.920s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-db6bd8df-f755-40da-9640-b6d6144e1346" released by "delete_snapshot" :: held 1.964s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (a8deec65-cc50-45ef-8273-657d5a3281f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30e1df7-1e38-4830-bbcd-7968e85f71e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Flow 'volume_create_manager' (7e18ccfc-db74-4ca1-adfd-e66b55cf2461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a92502b-3449-4210-a486-974a157b324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30e1df7-1e38-4830-bbcd-7968e85f71e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555944923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dffb13-d156-4f6e-b360-c8a0cd0421ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:53Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0cdf22-9dd0-4dbc-bafb-14c78d0c3e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0cdf22-9dd0-4dbc-bafb-14c78d0c3e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd02672-192f-436f-8d3d-92d9e8ce2513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd02672-192f-436f-8d3d-92d9e8ce2513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03dffb13-d156-4f6e-b360-c8a0cd0421ee', 'volume_name': 'volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a6afbd-8ff2-4c88-909c-d4b2680c74cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a6afbd-8ff2-4c88-909c-d4b2680c74cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64df1235-f37d-4b6c-8ed5-831d60874742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Volume 03dffb13-d156-4f6e-b360-c8a0cd0421ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee', 'volume_size': 1} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555944923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dffb13-d156-4f6e-b360-c8a0cd0421ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0940b976a3a74928b96efba73b8972cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:53Z,use_quota=True,user_id='e4eca28818b242328a69a0ee650f365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Creating volume 03dffb13-d156-4f6e-b360-c8a0cd0421ee {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:52 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a92502b-3449-4210-a486-974a157b324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1543789359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c69364-ecee-4493-8a58-f8b071dd94d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3f42fa11c94a638bc4dce37a9e3bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:53Z,use_quota=True,user_id='6b5977e0a8ed4d74af2e62cea49d4915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee 1073741824 Sep 28 18:20:52 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee1f5d4-de06-4d7f-8418-891c7f5b374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee1f5d4-de06-4d7f-8418-891c7f5b374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9053d51f-bde1-46f5-a2d9-2a2fc14c0189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9053d51f-bde1-46f5-a2d9-2a2fc14c0189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c69364-ecee-4493-8a58-f8b071dd94d6', 'volume_name': 'volume-52c69364-ecee-4493-8a58-f8b071dd94d6', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e157937a-785b-4973-9b6d-52d4a16e3f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e157937a-785b-4973-9b6d-52d4a16e3f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1623048f-5667-4eab-b15d-fa5dd89487fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:52 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Volume 52c69364-ecee-4493-8a58-f8b071dd94d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c69364-ecee-4493-8a58-f8b071dd94d6', 'volume_size': 1} Sep 28 18:20:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:52 devstack cinder-volume[86981]: WARNING cinder.quota [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-849028931 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-849028931, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:52 devstack cinder-volume[86981]: WARNING cinder.quota [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-849028931 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-849028931, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['ac5f9879-2455-4d44-b2dd-0d3f96e23e35', 'b7baed3d-8749-49a3-8b39-f0408bcb1bcf', '4121b4dd-cffd-4c94-893a-977a98cc8517', '55524ff9-4d35-40c5-a38c-6f8c0e5b559f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['fc27e4f2-2f08-4ed6-8762-4504cb797371', '1e7ea448-f8b8-4841-9da8-7cd7c3aa511d', '7c4b746a-7ded-4c83-872d-e0c811efa164', '7ce1be15-dace-4ecc-b153-91a29e5b4bc3'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7a9521fb-6dee-4d0e-8855-5c72e067f0d5 tempest-GroupSnapshotsTest-1912329485 None] group_snapshot fbe96ccd-7b8c-408a-8815-f8c25b177586: deleted successfully Sep 28 18:20:53 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee 1073741824" returned: 0 in 0.584s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:53 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee Sep 28 18:20:53 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-db6bd8df-f755-40da-9640-b6d6144e1346" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-db6bd8df-f755-40da-9640-b6d6144e1346" acquired by "delete_volume" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:53 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee" returned: 0 in 0.346s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[863f08bb-e38b-46a8-a840-bb1ec5d8fefd]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.906s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1543789359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c69364-ecee-4493-8a58-f8b071dd94d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3f42fa11c94a638bc4dce37a9e3bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:53Z,use_quota=True,user_id='6b5977e0a8ed4d74af2e62cea49d4915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Creating volume 52c69364-ecee-4493-8a58-f8b071dd94d6 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:53 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:53 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 1073741824 Sep 28 18:20:53 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64df1235-f37d-4b6c-8ed5-831d60874742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35bdf1f-278e-4fb4-83c8-07ea75158910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:53 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Volume volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee (03dffb13-d156-4f6e-b360-c8a0cd0421ee): created successfully Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35bdf1f-278e-4fb4-83c8-07ea75158910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Flow 'volume_create_manager' (a8deec65-cc50-45ef-8273-657d5a3281f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-62ffdff0-7107-4256-92d2-0a74398ddaeb tempest-ProjectReaderTests-1669226618 None] Created volume successfully. Sep 28 18:20:54 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 Sep 28 18:20:54 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:54 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346" returned: 0 in 0.470s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:54 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346 Sep 28 18:20:54 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-03dffb13-d156-4f6e-b360-c8a0cd0421ee-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:54 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 1073741824" returned: 0 in 0.673s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=134,cinder:UPDATE=143,cinder:INSERT=28,cinder:DELETE=10 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-03dffb13-d156-4f6e-b360-c8a0cd0421ee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "cinder-quobyte-03dffb13-d156-4f6e-b360-c8a0cd0421ee" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:54 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 Sep 28 18:20:54 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-03dffb13-d156-4f6e-b360-c8a0cd0421ee" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d5ca03-aa3a-413c-b99c-a1b8eb70260b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:54 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db6bd8df-f755-40da-9640-b6d6144e1346" returned: 0 in 0.428s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-db6bd8df-f755-40da-9640-b6d6144e1346" released by "delete_volume" :: held 1.030s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-e7832a36-f487-4349-bec2-d38aa3812fdb" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-e7832a36-f487-4349-bec2-d38aa3812fdb" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:54 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee Sep 28 18:20:54 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b250b00-95c9-4d5b-85c3-c48159b41b6b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:54 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6" returned: 0 in 0.367s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=138,cinder:DELETE=8,cinder:SELECT=120,cinder:INSERT=43 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1623048f-5667-4eab-b15d-fa5dd89487fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c69364-ecee-4493-8a58-f8b071dd94d6', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:55 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb Sep 28 18:20:55 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2679a3a9-bbcb-4444-b60b-d9e068c8f568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:55 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Volume volume-52c69364-ecee-4493-8a58-f8b071dd94d6 (52c69364-ecee-4493-8a58-f8b071dd94d6): created successfully Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2679a3a9-bbcb-4444-b60b-d9e068c8f568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Flow 'volume_create_manager' (7e18ccfc-db74-4ca1-adfd-e66b55cf2461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4d0c2843-126e-41d3-93a1-0e8024e49c9d tempest-VolumesListAdminTestJSON-1663724221 None] Created volume successfully. Sep 28 18:20:55 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee" returned: 0 in 0.601s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:55 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee Sep 28 18:20:55 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:55 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb" returned: 0 in 0.515s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:55 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb Sep 28 18:20:55 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:55 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-03dffb13-d156-4f6e-b360-c8a0cd0421ee" returned: 0 in 0.308s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-quobyte-03dffb13-d156-4f6e-b360-c8a0cd0421ee" released by "delete_volume" :: held 0.961s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Created reservations ['ffb260ee-aff8-436c-9aa9-03076a07b6f1', 'f5f13b18-b834-4fcb-a3d8-ad6036b7fdc1', '898440cd-dbf7-42fa-b175-90e3be4feaf0', 'dc1eb5b9-ebf7-4184-9f4c-49125eef22ef'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:55 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e7832a36-f487-4349-bec2-d38aa3812fdb" returned: 0 in 0.374s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:55 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:55 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-e7832a36-f487-4349-bec2-d38aa3812fdb" released by "delete_volume" :: held 1.003s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['a510e5fa-e601-4707-b9e0-3facc0929165'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:56 devstack cinder-volume[86981]: WARNING cinder.quota [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-849028931 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-849028931, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['d0be1178-2a20-4231-997c-4fc50fa2c936', '523e4877-77ff-4c6d-9a7c-22fc1fea6c83', '36f1de24-55ca-4fda-aa33-c758a2484fba', 'bab96de8-8a5b-4603-bbde-07d0fd467c25'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:56 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.384s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Deleted volume successfully. Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1c5eb31e-bcb0-4974-85bf-16840125c178 tempest-ProjectReaderTests-1669226618 None] Lock "cinder-03dffb13-d156-4f6e-b360-c8a0cd0421ee-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['1a4e7c3b-b4b8-49f8-95f4-fc9010857335', 'df48714c-2081-4ebd-be3c-ddedf3582ce4', '3af3934e-ef43-4df0-8301-0dad54ef916e', '20027555-e423-4e63-a61a-c7484c9cc22e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Flow 'volume_create_manager' (20ae2d77-ce69-4c63-8119-3a679cafd1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b64ca7-25fb-4731-8926-7f5d96f6a299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b64ca7-25fb-4731-8926-7f5d96f6a299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1435578167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87982d6-fb66-4278-a18c-88c6eb632ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3f42fa11c94a638bc4dce37a9e3bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:56Z,use_quota=True,user_id='6b5977e0a8ed4d74af2e62cea49d4915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fcd033-a782-4274-95b1-e13ef7fdcf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fcd033-a782-4274-95b1-e13ef7fdcf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675450cf-91f0-46ee-b5a9-11ee8878667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675450cf-91f0-46ee-b5a9-11ee8878667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87982d6-fb66-4278-a18c-88c6eb632ea3', 'volume_name': 'volume-f87982d6-fb66-4278-a18c-88c6eb632ea3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95421fe-25af-46c6-9872-d43936d3b253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95421fe-25af-46c6-9872-d43936d3b253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82663bf-144b-4e0d-b271-b6f4a9338b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:56 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Volume f87982d6-fb66-4278-a18c-88c6eb632ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87982d6-fb66-4278-a18c-88c6eb632ea3', 'volume_size': 1} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1435578167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87982d6-fb66-4278-a18c-88c6eb632ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c3f42fa11c94a638bc4dce37a9e3bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:56Z,use_quota=True,user_id='6b5977e0a8ed4d74af2e62cea49d4915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Creating volume f87982d6-fb66-4278-a18c-88c6eb632ea3 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:56 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:56 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 1073741824 Sep 28 18:20:56 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:56 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:20:56 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:57 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:57 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 1073741824" returned: 0 in 0.701s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.509s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:57 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5e6a53bc-b781-4adb-82e9-8fb27d0a9cc6 tempest-GroupSnapshotsTest-1912329485 None] Delete group completed successfully. Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:57 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 Sep 28 18:20:57 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:57 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3" returned: 0 in 0.344s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82663bf-144b-4e0d-b271-b6f4a9338b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87982d6-fb66-4278-a18c-88c6eb632ea3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1075d9cb-ddfe-4b25-a64d-f1a65a1cd531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Volume volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 (f87982d6-fb66-4278-a18c-88c6eb632ea3): created successfully Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1075d9cb-ddfe-4b25-a64d-f1a65a1cd531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Flow 'volume_create_manager' (20ae2d77-ce69-4c63-8119-3a679cafd1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:57 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2cf4cd7b-f84b-4d21-88ca-ee78065cf2c6 tempest-VolumesListAdminTestJSON-1663724221 None] Created volume successfully. Sep 28 18:20:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-283f200e-6de9-4ec3-a44a-a2028599643c tempest-GroupSnapshotsTest-1912329485 None] Group tempest-GroupSnapshotsTest-Group-926467952: creating Sep 28 18:20:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-283f200e-6de9-4ec3-a44a-a2028599643c tempest-GroupSnapshotsTest-1912329485 None] Group tempest-GroupSnapshotsTest-Group-926467952: created successfully Sep 28 18:20:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-283f200e-6de9-4ec3-a44a-a2028599643c tempest-GroupSnapshotsTest-1912329485 None] Create group completed successfully. Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Flow 'volume_create_manager' (6a303c82-70e5-4318-8a24-f6b3bb5aed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aafa81-71ab-4179-ad4d-cd93586dd438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aafa81-71ab-4179-ad4d-cd93586dd438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc402e57-5742-468f-8916-42c5bdc8e81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e36cda064e44489f43ad7b999a9d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:00Z,use_quota=True,user_id='79415f2b91284cf8b9375dc5c7e826de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628aa14e-be61-46bb-94da-877883e6e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628aa14e-be61-46bb-94da-877883e6e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51577c5-823f-40a7-8fda-842fe1c6f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51577c5-823f-40a7-8fda-842fe1c6f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc402e57-5742-468f-8916-42c5bdc8e81a', 'volume_name': 'volume-cc402e57-5742-468f-8916-42c5bdc8e81a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac72b9a-4cf9-4b6f-8ae2-4f96f081d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac72b9a-4cf9-4b6f-8ae2-4f96f081d4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f9771-15a2-4fdb-a7b1-ec08f2a1f2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Volume cc402e57-5742-468f-8916-42c5bdc8e81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc402e57-5742-468f-8916-42c5bdc8e81a', 'volume_size': 1} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc402e57-5742-468f-8916-42c5bdc8e81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e36cda064e44489f43ad7b999a9d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:00Z,use_quota=True,user_id='79415f2b91284cf8b9375dc5c7e826de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Creating volume cc402e57-5742-468f-8916-42c5bdc8e81a {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:00 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a 1073741824 Sep 28 18:21:00 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (e21eed02-3f25-4406-96f3-56fdd03655fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89aa17c-b6ea-4a01-a76a-a04ea364c1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89aa17c-b6ea-4a01-a76a-a04ea364c1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1989417901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f54d6f4-2c07-4082-acc1-820df4b99353,host='devstack@QuobyteHD#QuobyteHD',id=ec440d44-a797-41c9-90f1-53776afa0629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:00Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6c3c227-5941-450c-84c9-34d323d245bd),volume_type_id=e6c3c227-5941-450c-84c9-34d323d245bd)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec8eac4-e6d2-4de8-bcbe-a30b7eaa6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec8eac4-e6d2-4de8-bcbe-a30b7eaa6858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63860ef-1cc5-40fd-8303-6c40f69c1870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63860ef-1cc5-40fd-8303-6c40f69c1870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec440d44-a797-41c9-90f1-53776afa0629', 'volume_name': 'volume-ec440d44-a797-41c9-90f1-53776afa0629', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5f3aa-c459-48cb-a26c-36e9000b4bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5f3aa-c459-48cb-a26c-36e9000b4bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b7f3cf-2db9-4731-9d13-9f84340e37ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Volume ec440d44-a797-41c9-90f1-53776afa0629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec440d44-a797-41c9-90f1-53776afa0629', 'volume_size': 1} Sep 28 18:21:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:01 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a 1073741824" returned: 0 in 0.725s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a Sep 28 18:21:01 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a" returned: 0 in 0.294s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f54d6f4-2c07-4082-acc1-820df4b99353,created_at=2026-09-28T16:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1989417901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f54d6f4-2c07-4082-acc1-820df4b99353,host='devstack@QuobyteHD#QuobyteHD',id=ec440d44-a797-41c9-90f1-53776afa0629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3e0cd65fd147a3b44425df5e026828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:00Z,use_quota=True,user_id='226acd55fdb24d15a974edea6037dd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6c3c227-5941-450c-84c9-34d323d245bd),volume_type_id=e6c3c227-5941-450c-84c9-34d323d245bd)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Creating volume ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:01 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376f9771-15a2-4fdb-a7b1-ec08f2a1f2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc402e57-5742-468f-8916-42c5bdc8e81a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:01 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 1073741824 Sep 28 18:21:01 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21195e37-996e-4296-b5f2-669d1d63e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:01 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Volume volume-cc402e57-5742-468f-8916-42c5bdc8e81a (cc402e57-5742-468f-8916-42c5bdc8e81a): created successfully Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21195e37-996e-4296-b5f2-669d1d63e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Flow 'volume_create_manager' (6a303c82-70e5-4318-8a24-f6b3bb5aed0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c227a4bd-2372-4b29-8fc5-bc2f08d81d9e tempest-VolumesListAdminTestJSON-1126580060 None] Created volume successfully. Sep 28 18:21:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8f731045-2bf1-42ca-b06c-881f2bffedf9 req-ef17d054-4693-4963-b034-0b301815ad09 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:02 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 1073741824" returned: 0 in 0.635s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 Sep 28 18:21:02 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Acquiring lock "cinder-cc402e57-5742-468f-8916-42c5bdc8e81a-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8f731045-2bf1-42ca-b06c-881f2bffedf9 req-ef17d054-4693-4963-b034-0b301815ad09 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.681s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b7f3cf-2db9-4731-9d13-9f84340e37ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec440d44-a797-41c9-90f1-53776afa0629', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c679e2-df8d-4a34-8e9e-fde5b27460a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Lock "cinder-cc402e57-5742-468f-8916-42c5bdc8e81a-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8f731045-2bf1-42ca-b06c-881f2bffedf9 req-ef17d054-4693-4963-b034-0b301815ad09 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:02 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Volume volume-ec440d44-a797-41c9-90f1-53776afa0629 (ec440d44-a797-41c9-90f1-53776afa0629): created successfully Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c679e2-df8d-4a34-8e9e-fde5b27460a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Flow 'volume_create_manager' (e21eed02-3f25-4406-96f3-56fdd03655fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-8f731045-2bf1-42ca-b06c-881f2bffedf9 req-ef17d054-4693-4963-b034-0b301815ad09 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e63c3323-da04-4270-9cdb-3adedd7c2e81', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:21:02 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-45b59cd6-8ef6-48e0-a6e1-63b23b64cc4f tempest-GroupSnapshotsTest-1912329485 None] Created volume successfully. Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Acquiring lock "cinder-quobyte-cc402e57-5742-468f-8916-42c5bdc8e81a" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Lock "cinder-quobyte-cc402e57-5742-468f-8916-42c5bdc8e81a" acquired by "delete_volume" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d4499-035f-4c03-9201-3ad534a6118b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-8f731045-2bf1-42ca-b06c-881f2bffedf9 req-ef17d054-4693-4963-b034-0b301815ad09 tempest-TestServerVolumeAttachmentScenario-2013987090 None] attachment_update completed successfully. Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "cinder-f87982d6-fb66-4278-a18c-88c6eb632ea3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-f87982d6-fb66-4278-a18c-88c6eb632ea3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "cinder-quobyte-f87982d6-fb66-4278-a18c-88c6eb632ea3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:02 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a Sep 28 18:21:02 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-quobyte-f87982d6-fb66-4278-a18c-88c6eb632ea3" acquired by "delete_volume" :: waited 0.040s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c4d85a-bb92-4c3f-83b6-bbc1d8f08153]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 Sep 28 18:21:03 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:03 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a" returned: 0 in 0.696s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a Sep 28 18:21:03 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:03 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3" returned: 0 in 0.742s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] GroupSnapshot 7a8e4322-06a9-4662-8ef2-f66caba75233: creating. Sep 28 18:21:03 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3 Sep 28 18:21:03 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:03 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-cc402e57-5742-468f-8916-42c5bdc8e81a" returned: 0 in 0.464s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Group snapshot 7a8e4322-06a9-4662-8ef2-f66caba75233: creating. {{(pid=86981) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Lock "cinder-quobyte-cc402e57-5742-468f-8916-42c5bdc8e81a" released by "delete_volume" :: held 1.270s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Creating offline snapshot 3cb8141a-1130-4b00-8946-afa4de59d4fc of volume ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a32c021-3ac3-44bc-b442-267b2a21e85a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Created reservations ['0f42d317-3531-490f-ab8f-bea45506f452', 'ffe2eb87-5e60-4610-adc2-c1dfa2cfec13', 'ebdc5e8b-b0ac-4c14-a987-ca7073bd26b1', '64fbdc82-b95a-4763-83ef-a8866257f61a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:04 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 Sep 28 18:21:04 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f87982d6-fb66-4278-a18c-88c6eb632ea3" returned: 0 in 0.467s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-quobyte-f87982d6-fb66-4278-a18c-88c6eb632ea3" released by "delete_volume" :: held 1.284s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:04 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:04 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Created reservations ['3d41ad32-ed57-480b-b115-9dd0ee1c4b6f', '27ac84fb-f028-40ce-af3e-1764c71d2981', '525d4a66-e2c1-422f-b327-c7e40e18bd97', '70bee98d-7966-461b-b14a-8aed7a2a6efd'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:04 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629" returned: 0 in 0.572s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.374s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Deleted volume successfully. Sep 28 18:21:04 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:04 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc 1G Sep 28 18:21:04 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9064cfa6-80d3-4db3-9fc3-539c94f445d1 tempest-VolumesListAdminTestJSON-1126580060 None] Lock "cinder-cc402e57-5742-468f-8916-42c5bdc8e81a-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:05 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.434s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:05 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Deleted volume successfully. Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bd9a6529-7d7a-4c02-81d6-46f3509cf28c tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-f87982d6-fb66-4278-a18c-88c6eb632ea3-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:05 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc 1G" returned: 0 in 0.642s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec440d44-a797-41c9-90f1-53776afa0629 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:05 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec440d44-a797-41c9-90f1-53776afa0629 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc Sep 28 18:21:05 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "cinder-52c69364-ecee-4493-8a58-f8b071dd94d6-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-52c69364-ecee-4493-8a58-f8b071dd94d6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "cinder-quobyte-52c69364-ecee-4493-8a58-f8b071dd94d6" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-quobyte-52c69364-ecee-4493-8a58-f8b071dd94d6" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b760087-3833-4d9d-adaf-cc84e1698048]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:05 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 Sep 28 18:21:05 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:05 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec440d44-a797-41c9-90f1-53776afa0629 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc" returned: 0 in 0.558s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:21:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:05 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc Sep 28 18:21:05 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6" returned: 0 in 0.605s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc" returned: 0 in 0.397s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6 Sep 28 18:21:06 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.info Sep 28 18:21:06 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52c69364-ecee-4493-8a58-f8b071dd94d6" returned: 0 in 0.412s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.info" returned: 0 in 0.360s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-quobyte-52c69364-ecee-4493-8a58-f8b071dd94d6" released by "delete_volume" :: held 1.095s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:06 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.info Sep 28 18:21:06 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Created reservations ['c290ee18-ef56-4cab-a7b1-ea46e055b4eb', 'ba9a83c3-b014-4355-907d-78861541a2d3', 'ce62a0e1-e2e0-4ae9-b815-137baa2d6621', 'f591b41c-4c15-423f-89f6-18b1484f222c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:06 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.info" returned: 0 in 0.499s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.182s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:07 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.463s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Deleted volume successfully. Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-634cabad-3c09-4fe5-9edb-a6ae459070dc tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-52c69364-ecee-4493-8a58-f8b071dd94d6-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3c087135-8c66-459f-8842-162de6b0140f tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 7a8e4322-06a9-4662-8ef2-f66caba75233: created successfully Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "cinder-3a925961-4c56-4a1f-b369-3e080d8f0994-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-3a925961-4c56-4a1f-b369-3e080d8f0994-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "cinder-quobyte-3a925961-4c56-4a1f-b369-3e080d8f0994" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-quobyte-3a925961-4c56-4a1f-b369-3e080d8f0994" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b453722e-32fc-4d11-9c77-b3f14b555842]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 Sep 28 18:21:08 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:08 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994" returned: 0 in 0.646s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994 Sep 28 18:21:08 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:08 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 7a8e4322-06a9-4662-8ef2-f66caba75233: deleting Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 7a8e4322-06a9-4662-8ef2-f66caba75233: deleting {{(pid=86981) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-ec440d44-a797-41c9-90f1-53776afa0629" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-ec440d44-a797-41c9-90f1-53776afa0629" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-3cb8141a-1130-4b00-8946-afa4de59d4fc" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-3cb8141a-1130-4b00-8946-afa4de59d4fc" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Deleting offline snapshot 3cb8141a-1130-4b00-8946-afa4de59d4fc of volume ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] snapshot_file for this snap is: volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f52dd-4b60-4ee0-937d-a81324c2f67a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3a925961-4c56-4a1f-b369-3e080d8f0994" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-quobyte-3a925961-4c56-4a1f-b369-3e080d8f0994" released by "delete_volume" :: held 1.192s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Created reservations ['512b8124-d7e7-4bd9-ae9a-d774d0eeafc3', 'e322d10d-f91a-4c9f-b188-f1030cc195b6', '1ef6361d-cfa7-4549-b461-19a17bc63bb3', 'f6adeb03-4080-4041-aa59-786ef8e67d55'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:09 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc Sep 28 18:21:09 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:09 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:09 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-80609f93-74b2-4e96-a497-9acd1595de1d req-dcd77b5d-caf5-4198-85e6-c99d3071dd97 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-80609f93-74b2-4e96-a497-9acd1595de1d req-dcd77b5d-caf5-4198-85e6-c99d3071dd97 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-80609f93-74b2-4e96-a497-9acd1595de1d req-dcd77b5d-caf5-4198-85e6-c99d3071dd97 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-80609f93-74b2-4e96-a497-9acd1595de1d req-dcd77b5d-caf5-4198-85e6-c99d3071dd97 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec8c812c-e5d3-4dcd-9ee7-08af39fc5f38', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:21:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-80609f93-74b2-4e96-a497-9acd1595de1d req-dcd77b5d-caf5-4198-85e6-c99d3071dd97 tempest-TestServerVolumeAttachmentScenario-2013987090 None] attachment_update completed successfully. Sep 28 18:21:09 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Deleted volume successfully. Sep 28 18:21:09 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3475e50d-d7dd-4003-bbf7-18f38990b991 tempest-VolumesListAdminTestJSON-1663724221 None] Lock "cinder-3a925961-4c56-4a1f-b369-3e080d8f0994-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc" returned: 0 in 0.688s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec440d44-a797-41c9-90f1-53776afa0629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1c4e1-c6e6-4abf-9213-e1bfb0e5ce48]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:10 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 Sep 28 18:21:10 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:10 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629" returned: 0 in 0.747s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:10 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc Sep 28 18:21:10 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc" returned: 0 in 0.639s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc Sep 28 18:21:11 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629.3cb8141a-1130-4b00-8946-afa4de59d4fc" returned: 0 in 0.386s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-3cb8141a-1130-4b00-8946-afa4de59d4fc" released by "_delete_snapshot" :: held 2.656s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-ec440d44-a797-41c9-90f1-53776afa0629" released by "delete_snapshot" :: held 2.721s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:11 devstack cinder-volume[86981]: WARNING cinder.quota [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-317038162 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-317038162, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:11 devstack cinder-volume[86981]: WARNING cinder.quota [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-317038162 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-317038162, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:11 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['586e57b6-4fa2-47b8-b564-2c9e467f93f9', 'c8f7bb20-abe9-4f29-9037-fe5e76d3cd42', '2f3037b7-2c4e-4760-b00b-5bcdd66d3b3e', '7f5fb2e5-d880-4a1a-895f-5e99a0b7306b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1eeea031-c0f8-49c5-ac58-58202dbb5e3e tempest-GroupSnapshotsTest-1912329485 None] group_snapshot 7a8e4322-06a9-4662-8ef2-f66caba75233: deleted successfully Sep 28 18:21:12 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-2baaf078-3c6b-4d78-ba12-f7345aad61b9 req-a496853f-4f23-481e-9b51-5a8913bf0f86 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Terminate volume connection completed successfully. Sep 28 18:21:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-2baaf078-3c6b-4d78-ba12-f7345aad61b9 req-a496853f-4f23-481e-9b51-5a8913bf0f86 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Deleting attachment ec8c812c-e5d3-4dcd-9ee7-08af39fc5f38. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:21:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "cinder-quobyte-ec440d44-a797-41c9-90f1-53776afa0629" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-ec440d44-a797-41c9-90f1-53776afa0629" acquired by "delete_volume" :: waited 0.040s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:12 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[065a7196-1443-4c17-9e68-683360b53fe7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:13 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 Sep 28 18:21:13 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:13 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629" returned: 0 in 0.597s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:13 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629 Sep 28 18:21:13 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:13 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec440d44-a797-41c9-90f1-53776afa0629" returned: 0 in 0.429s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Lock "cinder-quobyte-ec440d44-a797-41c9-90f1-53776afa0629" released by "delete_volume" :: held 1.218s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['0af408ec-0285-4bf8-ba22-e640f05edc92'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:14 devstack cinder-volume[86981]: WARNING cinder.quota [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-317038162 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-317038162, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Created reservations ['964d8eda-a23e-4a24-b2d6-a770750ad936', 'd7772032-4808-4ec9-8323-886987fcaeb3', '80ff413e-3b51-4079-9e88-0329859fdc04', '2dbc96aa-8b18-42dc-b904-027d4d1bd06a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:14 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:14 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-2e54c824-aa98-482c-a0d4-135996b3554d req-ef74e8b9-b610-471a-ae8a-df178587b1ee tempest-TestServerVolumeAttachmentScenario-2013987090 None] Terminate volume connection completed successfully. Sep 28 18:21:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-2e54c824-aa98-482c-a0d4-135996b3554d req-ef74e8b9-b610-471a-ae8a-df178587b1ee tempest-TestServerVolumeAttachmentScenario-2013987090 None] Deleting attachment e63c3323-da04-4270-9cdb-3adedd7c2e81. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:21:15 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.498s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:15 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b7f37ef6-2b1e-410b-897f-e7d360a613c6 tempest-GroupSnapshotsTest-1912329485 None] Delete group completed successfully. Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Flow 'volume_create_manager' (02ea1dc1-5929-4f39-ab4e-1d332f23694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaaf84c-97fd-4f47-a7eb-c613cd1d2ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaaf84c-97fd-4f47-a7eb-c613cd1d2ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-274027494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71d5cd2-9c37-4692-9520-37a52813df51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc649186021b43dfb7075cf80ad95d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:19Z,use_quota=True,user_id='f8668003f9254e8cbb271434a369337a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda063a0-937c-44d8-81d1-ac6a38f4aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda063a0-937c-44d8-81d1-ac6a38f4aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6811b0-84bc-4503-ba6c-689995c7ef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6811b0-84bc-4503-ba6c-689995c7ef79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71d5cd2-9c37-4692-9520-37a52813df51', 'volume_name': 'volume-e71d5cd2-9c37-4692-9520-37a52813df51', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303457c6-b78e-47fb-bfda-fd1774459f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303457c6-b78e-47fb-bfda-fd1774459f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978b867a-4e4e-4039-9242-b20cd5f1a36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Volume e71d5cd2-9c37-4692-9520-37a52813df51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71d5cd2-9c37-4692-9520-37a52813df51', 'volume_size': 1} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-274027494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71d5cd2-9c37-4692-9520-37a52813df51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc649186021b43dfb7075cf80ad95d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:19Z,use_quota=True,user_id='f8668003f9254e8cbb271434a369337a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Creating volume e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:19 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:21:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:19 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 1073741824 Sep 28 18:21:19 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:20 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 1073741824" returned: 0 in 0.903s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:20 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 Sep 28 18:21:20 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:20 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51" returned: 0 in 0.453s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978b867a-4e4e-4039-9242-b20cd5f1a36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71d5cd2-9c37-4692-9520-37a52813df51', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cfb163-4048-4916-b9f7-c6c168bc7a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:21 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Volume volume-e71d5cd2-9c37-4692-9520-37a52813df51 (e71d5cd2-9c37-4692-9520-37a52813df51): created successfully Sep 28 18:21:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cfb163-4048-4916-b9f7-c6c168bc7a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Flow 'volume_create_manager' (02ea1dc1-5929-4f39-ab4e-1d332f23694d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6ddb36d8-2abb-4434-9aa9-b186d2bce332 tempest-SnapshotMetadataTestJSON-408532074 None] Created volume successfully. Sep 28 18:21:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Creating offline snapshot 06de63ad-343c-4b44-89bb-3995977bcab9 of volume e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:23 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a38d53-d942-493c-9fca-015eb6f0dcd7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 Sep 28 18:21:23 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51" returned: 0 in 0.591s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 1G Sep 28 18:21:23 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "cinder-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "cinder-quobyte-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:24 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-quobyte-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0" acquired by "delete_volume" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 1G" returned: 0 in 0.733s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71d5cd2-9c37-4692-9520-37a52813df51 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[087c4b1d-ab90-479e-adf3-1dd6b1fab0a9]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:24 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71d5cd2-9c37-4692-9520-37a52813df51 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 Sep 28 18:21:24 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 Sep 28 18:21:24 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71d5cd2-9c37-4692-9520-37a52813df51 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9" returned: 0 in 0.502s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 is being set with open permissions: ugo+rw Sep 28 18:21:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:24 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 Sep 28 18:21:24 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0" returned: 0 in 0.697s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0 Sep 28 18:21:25 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9" returned: 0 in 0.498s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.info Sep 28 18:21:25 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0" returned: 0 in 0.395s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-quobyte-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0" released by "delete_volume" :: held 1.164s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Created reservations ['82703629-6d41-46e9-995e-96fa51fe9dcc', '2f131f28-0ebb-42ca-b4d8-4e1316b0d73e', 'f4932f5d-5b46-4823-81f6-14755cd15f4f', '46e38c73-2124-41c1-87d2-1700b423bf64'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:25 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:25 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.info" returned: 0 in 0.367s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:25 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.info is being set with open permissions: ugo+rw Sep 28 18:21:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.info Sep 28 18:21:25 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.365s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Deleted volume successfully. Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-697dfdab-1b80-4993-8dbe-43b6f82b943a tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-7f0d3f76-a18e-4d5e-bf8a-e0b6520d0ce0-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:26 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.info" returned: 0 in 0.385s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.239s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b53b65a5-f132-4a0b-b86c-cace7be0d32b tempest-SnapshotMetadataTestJSON-408532074 None] Create snapshot completed successfully Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "cinder-9b17b290-48bb-4630-a3d3-f54d9d3b61e7-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-9b17b290-48bb-4630-a3d3-f54d9d3b61e7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "cinder-quobyte-9b17b290-48bb-4630-a3d3-f54d9d3b61e7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-quobyte-9b17b290-48bb-4630-a3d3-f54d9d3b61e7" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[747241bb-d602-48ae-abed-f0e671e2b701]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:26 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 Sep 28 18:21:26 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7" returned: 0 in 0.577s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:27 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7 Sep 28 18:21:27 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9b17b290-48bb-4630-a3d3-f54d9d3b61e7" returned: 0 in 0.443s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-quobyte-9b17b290-48bb-4630-a3d3-f54d9d3b61e7" released by "delete_volume" :: held 1.093s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:27 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Created reservations ['1beb238a-410a-4e7e-b2bd-4dcc8a704024', 'ac81c5d9-6a34-4529-8ba6-f97f1520cdcb', '2f452766-94e8-48cc-85e2-d55453388257', '75418abe-e85e-4279-86e7-fc45dcdac4ef'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-60b2e4e4-d9b5-4add-ac07-e89e570e878a tempest-GroupSnapshotsV319Test-525251312 None] Group tempest-GroupSnapshotsV319Test-Group-1761253358: creating Sep 28 18:21:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-60b2e4e4-d9b5-4add-ac07-e89e570e878a tempest-GroupSnapshotsV319Test-525251312 None] Group tempest-GroupSnapshotsV319Test-Group-1761253358: created successfully Sep 28 18:21:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-60b2e4e4-d9b5-4add-ac07-e89e570e878a tempest-GroupSnapshotsV319Test-525251312 None] Create group completed successfully. Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:28 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:28 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:28 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.381s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Deleted volume successfully. Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2ff68749-d6f5-45d1-a76d-0311f5392ad1 tempest-TestServerVolumeAttachmentScenario-2013987090 None] Lock "cinder-9b17b290-48bb-4630-a3d3-f54d9d3b61e7-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "cinder-06de63ad-343c-4b44-89bb-3995977bcab9-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-06de63ad-343c-4b44-89bb-3995977bcab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "cinder-quobyte-e71d5cd2-9c37-4692-9520-37a52813df51" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-quobyte-e71d5cd2-9c37-4692-9520-37a52813df51" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "cinder-quobyte-06de63ad-343c-4b44-89bb-3995977bcab9" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-quobyte-06de63ad-343c-4b44-89bb-3995977bcab9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Deleting offline snapshot 06de63ad-343c-4b44-89bb-3995977bcab9 of volume e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] snapshot_file for this snap is: volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9951addd-c9a6-41a7-abb0-68ed08e0996d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:29 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 Sep 28 18:21:29 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:29 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9" returned: 0 in 0.559s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71d5cd2-9c37-4692-9520-37a52813df51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:29 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfbaef5-9043-4811-b08a-8011ff441842]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:29 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 Sep 28 18:21:29 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Flow 'volume_create_manager' (692a971c-d489-411d-8e26-84ff2bd2d302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5454882a-9324-408e-82c9-0d76df4786e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5454882a-9324-408e-82c9-0d76df4786e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970914707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ce4546c-689a-4cbf-9202-2616455db222,host='devstack@QuobyteHD#QuobyteHD',id=c034d78a-a467-47df-89a0-bc07353d3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d6d4031e65444b98ef15f2abf7e9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:30Z,use_quota=True,user_id='b548c4d8e4dd4b7992ba6a89d510f70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5085997e-44f0-4430-8bf9-fbc4e3f25844),volume_type_id=5085997e-44f0-4430-8bf9-fbc4e3f25844)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715125c5-e39a-4d38-9660-dc933b6218c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715125c5-e39a-4d38-9660-dc933b6218c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ccaeed-b204-43ab-b57c-00ed609833e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ccaeed-b204-43ab-b57c-00ed609833e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c034d78a-a467-47df-89a0-bc07353d3eff', 'volume_name': 'volume-c034d78a-a467-47df-89a0-bc07353d3eff', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730b765d-aa0b-4d35-8eb0-5e0de5e9c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730b765d-aa0b-4d35-8eb0-5e0de5e9c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ce2932-55a1-43c3-b402-fe450d33658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:30 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Volume c034d78a-a467-47df-89a0-bc07353d3eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c034d78a-a467-47df-89a0-bc07353d3eff', 'volume_size': 1} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ce4546c-689a-4cbf-9202-2616455db222,created_at=2026-09-28T16:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970914707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ce4546c-689a-4cbf-9202-2616455db222,host='devstack@QuobyteHD#QuobyteHD',id=c034d78a-a467-47df-89a0-bc07353d3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d6d4031e65444b98ef15f2abf7e9f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:30Z,use_quota=True,user_id='b548c4d8e4dd4b7992ba6a89d510f70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5085997e-44f0-4430-8bf9-fbc4e3f25844),volume_type_id=5085997e-44f0-4430-8bf9-fbc4e3f25844)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Creating volume c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:30 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:30 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff 1073741824 Sep 28 18:21:30 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51" returned: 0 in 0.897s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:30 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 Sep 28 18:21:30 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff 1073741824" returned: 0 in 0.764s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9" returned: 0 in 0.706s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:31 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9 Sep 28 18:21:31 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff Sep 28 18:21:31 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:31 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51.06de63ad-343c-4b44-89bb-3995977bcab9" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff" returned: 0 in 0.384s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ce2932-55a1-43c3-b402-fe450d33658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c034d78a-a467-47df-89a0-bc07353d3eff', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b39a98-33cc-42c5-a2c3-9e69b0bd38ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-quobyte-06de63ad-343c-4b44-89bb-3995977bcab9" released by "_delete_snapshot" :: held 2.811s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-quobyte-e71d5cd2-9c37-4692-9520-37a52813df51" released by "delete_snapshot" :: held 2.854s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:31 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Volume volume-c034d78a-a467-47df-89a0-bc07353d3eff (c034d78a-a467-47df-89a0-bc07353d3eff): created successfully Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b39a98-33cc-42c5-a2c3-9e69b0bd38ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Flow 'volume_create_manager' (692a971c-d489-411d-8e26-84ff2bd2d302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:31 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-91729773-1387-49bc-957b-5c5e32a7a950 tempest-GroupSnapshotsV319Test-525251312 None] Created volume successfully. Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Created reservations ['3d120c8d-f0c6-4e23-aa8b-8b2b83e66dd4', 'd0e54d43-947d-479e-8074-77c6849ef5e6', 'b0d8065f-b6d9-426e-ad68-bbcd50ccf650', '2f3126a1-084e-4ff3-b7f0-c7edbaae8c6c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:31 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Delete snapshot completed successfully. Sep 28 18:21:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0559fc6c-ac44-4213-9891-d5266547c25f tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-06de63ad-343c-4b44-89bb-3995977bcab9-delete_snapshot" released by "delete_snapshot" :: held 3.150s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "cinder-e71d5cd2-9c37-4692-9520-37a52813df51-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-e71d5cd2-9c37-4692-9520-37a52813df51-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "cinder-quobyte-e71d5cd2-9c37-4692-9520-37a52813df51" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-quobyte-e71d5cd2-9c37-4692-9520-37a52813df51" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:32 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d541dd-650e-4633-a48d-effb93257239]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:32 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 Sep 28 18:21:32 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:33 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51" returned: 0 in 0.672s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:33 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51 Sep 28 18:21:33 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] GroupSnapshot e9b193a9-a369-4518-9376-36173e8186ee: creating. Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Group snapshot e9b193a9-a369-4518-9376-36173e8186ee: creating. {{(pid=86981) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Creating offline snapshot e470b74b-2ad0-4101-a058-c5388ab7a1d5 of volume c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58269b3-0431-4f99-8b05-0ede258ddfc3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:33 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e71d5cd2-9c37-4692-9520-37a52813df51" returned: 0 in 0.484s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:33 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff Sep 28 18:21:33 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-quobyte-e71d5cd2-9c37-4692-9520-37a52813df51" released by "delete_volume" :: held 1.267s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Created reservations ['79f99c76-d8b0-4b81-8f93-a63efd065f97', '92898400-5682-4c96-8618-007607adbf4e', 'a56ed87d-8d89-4625-97a0-2f1661618a77', '22b91c6f-c26f-45f1-aaf8-50271a09fa7c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:33 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:33 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:33 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff" returned: 0 in 0.623s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 1G Sep 28 18:21:34 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.434s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:34 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Deleted volume successfully. Sep 28 18:21:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-aacfb634-a3a3-4168-966b-2101a060ed1a tempest-SnapshotMetadataTestJSON-408532074 None] Lock "cinder-e71d5cd2-9c37-4692-9520-37a52813df51-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:34 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 1G" returned: 0 in 0.883s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c034d78a-a467-47df-89a0-bc07353d3eff -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c034d78a-a467-47df-89a0-bc07353d3eff -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 Sep 28 18:21:34 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c034d78a-a467-47df-89a0-bc07353d3eff -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5" returned: 0 in 0.570s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:21:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 Sep 28 18:21:35 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5" returned: 0 in 0.404s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.info Sep 28 18:21:35 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:36 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.info" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:36 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:21:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:36 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.info Sep 28 18:21:36 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:36 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.info" returned: 0 in 0.308s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.311s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:36 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-57def40b-8cee-437d-9069-797f129b1237 tempest-GroupSnapshotsV319Test-525251312 None] group_snapshot e9b193a9-a369-4518-9376-36173e8186ee: created successfully Sep 28 18:21:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] group_snapshot e9b193a9-a369-4518-9376-36173e8186ee: deleting Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] group_snapshot e9b193a9-a369-4518-9376-36173e8186ee: deleting {{(pid=86981) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Acquiring lock "cinder-quobyte-c034d78a-a467-47df-89a0-bc07353d3eff" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Lock "cinder-quobyte-c034d78a-a467-47df-89a0-bc07353d3eff" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Acquiring lock "cinder-quobyte-e470b74b-2ad0-4101-a058-c5388ab7a1d5" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Lock "cinder-quobyte-e470b74b-2ad0-4101-a058-c5388ab7a1d5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Deleting offline snapshot e470b74b-2ad0-4101-a058-c5388ab7a1d5 of volume c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] snapshot_file for this snap is: volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7564341-f77b-4058-93ed-718abc339f75]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 Sep 28 18:21:38 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:38 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Flow 'volume_create_manager' (5b63372e-f1eb-48d6-9f38-9fe777941c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8436d2f-4fd8-4ba5-9308-248f34a62109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:39 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8436d2f-4fd8-4ba5-9308-248f34a62109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1472111539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c440c5-6f73-4d86-a593-8bdd0df17935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adfd35e22795496382abb4ff602d4919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:39Z,use_quota=True,user_id='0a1d48f71b934e5c9b5527af48f32f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bdf007-9d4d-45f1-9d7b-2418d467f7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bdf007-9d4d-45f1-9d7b-2418d467f7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3664637-caaf-4fcd-8cb3-008b34173cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3664637-caaf-4fcd-8cb3-008b34173cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c440c5-6f73-4d86-a593-8bdd0df17935', 'volume_name': 'volume-49c440c5-6f73-4d86-a593-8bdd0df17935', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15332a37-6b72-409b-9e0a-2384c2b71bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15332a37-6b72-409b-9e0a-2384c2b71bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:39 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b714b17b-b0b2-47ce-91a6-a127bc0228f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:39 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Volume 49c440c5-6f73-4d86-a593-8bdd0df17935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c440c5-6f73-4d86-a593-8bdd0df17935', 'volume_size': 1} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1472111539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c440c5-6f73-4d86-a593-8bdd0df17935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adfd35e22795496382abb4ff602d4919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:39Z,use_quota=True,user_id='0a1d48f71b934e5c9b5527af48f32f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Creating volume 49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:39 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5" returned: 0 in 0.722s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.496s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c034d78a-a467-47df-89a0-bc07353d3eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:39 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 1073741824 Sep 28 18:21:39 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba670cc4-0064-44e6-87a2-00a7dd0608b5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff Sep 28 18:21:39 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff" returned: 0 in 0.654s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 1073741824" returned: 0 in 0.756s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 Sep 28 18:21:40 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 Sep 28 18:21:40 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5" returned: 0 in 0.398s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935" returned: 0 in 0.330s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b714b17b-b0b2-47ce-91a6-a127bc0228f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c440c5-6f73-4d86-a593-8bdd0df17935', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:40 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5 Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648accdd-c4f4-4294-8be0-dda03bdede4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:40 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Volume volume-49c440c5-6f73-4d86-a593-8bdd0df17935 (49c440c5-6f73-4d86-a593-8bdd0df17935): created successfully Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648accdd-c4f4-4294-8be0-dda03bdede4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Flow 'volume_create_manager' (5b63372e-f1eb-48d6-9f38-9fe777941c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-426c72fd-3e4a-4157-833d-40c4e65487fe tempest-SnapshotDependencyTests-854568453 None] Created volume successfully. Sep 28 18:21:40 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff.e470b74b-2ad0-4101-a058-c5388ab7a1d5" returned: 0 in 0.344s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Lock "cinder-quobyte-e470b74b-2ad0-4101-a058-c5388ab7a1d5" released by "_delete_snapshot" :: held 2.323s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Lock "cinder-quobyte-c034d78a-a467-47df-89a0-bc07353d3eff" released by "delete_snapshot" :: held 2.358s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:40 devstack cinder-volume[86981]: WARNING cinder.quota [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-500074805 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-500074805, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:40 devstack cinder-volume[86981]: WARNING cinder.quota [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-500074805 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-500074805, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:41 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] Created reservations ['675ac8c3-c51a-41f9-b028-ce47b41ece72', '54a24d96-2305-442e-abf0-38870af0dc7a', '82f152c8-d00f-4ff7-9563-7fe79015bd54', 'b1920293-5958-42ad-8a69-0355c2a4807b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ee7cc601-7913-48e3-84ce-6c35c05bddf9 tempest-GroupSnapshotsV319Test-525251312 None] group_snapshot e9b193a9-a369-4518-9376-36173e8186ee: deleted successfully Sep 28 18:21:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Creating offline snapshot cb468b9a-6b93-4eab-ac6a-6ff9771fd61a of volume 49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebf720-40af-4af3-97ae-133e48c970fb]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:41 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 Sep 28 18:21:41 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935" returned: 0 in 0.568s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a 1G Sep 28 18:21:42 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Acquiring lock "cinder-quobyte-c034d78a-a467-47df-89a0-bc07353d3eff" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Lock "cinder-quobyte-c034d78a-a467-47df-89a0-bc07353d3eff" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d0d59f-253d-4ec8-adec-460583b339a5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff Sep 28 18:21:42 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a 1G" returned: 0 in 0.644s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c440c5-6f73-4d86-a593-8bdd0df17935 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c440c5-6f73-4d86-a593-8bdd0df17935 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a Sep 28 18:21:42 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff" returned: 0 in 0.517s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff Sep 28 18:21:43 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49c440c5-6f73-4d86-a593-8bdd0df17935 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a is being set with open permissions: ugo+rw Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a Sep 28 18:21:43 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c034d78a-a467-47df-89a0-bc07353d3eff" returned: 0 in 0.466s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" returned: 0 in 0.438s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Lock "cinder-quobyte-c034d78a-a467-47df-89a0-bc07353d3eff" released by "delete_volume" :: held 1.106s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.info Sep 28 18:21:43 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Created reservations ['5b9c01d6-0dfe-4c50-b91a-1602247d4ac7'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:43 devstack cinder-volume[86981]: WARNING cinder.quota [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-500074805 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-500074805, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:21:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Created reservations ['055de8b6-4cb8-4078-a44b-c8dd022302c1', 'c766af45-c4d3-4e67-815b-bd15ae0c17c6', 'f59331e1-ea6b-485a-96e7-87b927e4b143', 'c16c73ae-9f11-4e5a-b2ed-4b94c0dce2bf'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Flow 'volume_create_manager' (4d7db9af-318a-437d-b14f-cea25952191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3a2a18-5895-41b4-adb1-01285bf7f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:44 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.info" returned: 0 in 0.469s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.info is being set with open permissions: ugo+rw Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3a2a18-5895-41b4-adb1-01285bf7f854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-399957556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0381af-9da6-4018-a260-c7c0c734bb7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56e730faa32407f99ae03e53ff6fcf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:44Z,use_quota=True,user_id='fb6a23cf506c4846ad0af53de16f4805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:44 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.info Sep 28 18:21:44 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f714b686-a2b5-48ea-8ca8-f241fd5772eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f714b686-a2b5-48ea-8ca8-f241fd5772eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5412e305-c0aa-447b-b95a-2f4229ac2d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5412e305-c0aa-447b-b95a-2f4229ac2d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec0381af-9da6-4018-a260-c7c0c734bb7c', 'volume_name': 'volume-ec0381af-9da6-4018-a260-c7c0c734bb7c', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cc02a7-0638-4161-a5a2-4201d0a17843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cc02a7-0638-4161-a5a2-4201d0a17843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d55ab9a-2037-48cb-a936-86f092d2e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:44 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Volume ec0381af-9da6-4018-a260-c7c0c734bb7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec0381af-9da6-4018-a260-c7c0c734bb7c', 'volume_size': 1} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:44 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.info" returned: 0 in 0.270s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.962s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-399957556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0381af-9da6-4018-a260-c7c0c734bb7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56e730faa32407f99ae03e53ff6fcf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:44Z,use_quota=True,user_id='fb6a23cf506c4846ad0af53de16f4805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Creating volume ec0381af-9da6-4018-a260-c7c0c734bb7c {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:44 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c 1073741824 Sep 28 18:21:44 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3f9c1baa-b173-4400-a2e9-82ca49d82a34 tempest-SnapshotDependencyTests-854568453 None] Create snapshot completed successfully Sep 28 18:21:44 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.294s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:44 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ff081c68-5089-4b4d-a03c-29e17371844b tempest-GroupSnapshotsV319Test-525251312 None] Delete group completed successfully. Sep 28 18:21:45 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c 1073741824" returned: 0 in 0.693s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:45 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c Sep 28 18:21:45 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:45 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c" returned: 0 in 0.394s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d55ab9a-2037-48cb-a936-86f092d2e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec0381af-9da6-4018-a260-c7c0c734bb7c', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4866c474-1959-4163-900a-4e6a697d692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Volume volume-ec0381af-9da6-4018-a260-c7c0c734bb7c (ec0381af-9da6-4018-a260-c7c0c734bb7c): created successfully Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4866c474-1959-4163-900a-4e6a697d692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Flow 'volume_create_manager' (4d7db9af-318a-437d-b14f-cea25952191d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:45 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-823ee212-2893-4ff2-80af-8e9e4b4f6042 tempest-AbsoluteLimitsTests-1013510769 None] Created volume successfully. Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Flow 'volume_create_manager' (bb6f524e-806f-4241-b9d7-062f04e8aa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f1907e-e39a-485c-a6a3-00f321706819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f1907e-e39a-485c-a6a3-00f321706819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52283c85-1eed-43b9-ad68-c764d32bdfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adfd35e22795496382abb4ff602d4919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb468b9a-6b93-4eab-ac6a-6ff9771fd61a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:46Z,use_quota=True,user_id='0a1d48f71b934e5c9b5527af48f32f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6abf74-7254-4e6c-9931-bfdb91015ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6abf74-7254-4e6c-9931-bfdb91015ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ab444b-a74b-483d-a356-399d56159062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ab444b-a74b-483d-a356-399d56159062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52283c85-1eed-43b9-ad68-c764d32bdfb3', 'volume_name': 'volume-52283c85-1eed-43b9-ad68-c764d32bdfb3', 'volume_size': 1, 'snapshot_id': 'cb468b9a-6b93-4eab-ac6a-6ff9771fd61a'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a541c7a6-e75b-4f64-bf8d-e8bf944ba1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a541c7a6-e75b-4f64-bf8d-e8bf944ba1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d340ecc-4edd-43f5-9dc1-04dfc137cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Volume 52283c85-1eed-43b9-ad68-c764d32bdfb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52283c85-1eed-43b9-ad68-c764d32bdfb3', 'volume_size': 1, 'snapshot_id': 'cb468b9a-6b93-4eab-ac6a-6ff9771fd61a'} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-quobyte-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a-52283c85-1eed-43b9-ad68-c764d32bdfb3" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a-52283c85-1eed-43b9-ad68-c764d32bdfb3" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Creating volume 52283c85-1eed-43b9-ad68-c764d32bdfb3 from snapshot cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-quobyte-52283c85-1eed-43b9-ad68-c764d32bdfb3" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-52283c85-1eed-43b9-ad68-c764d32bdfb3" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] snapshot: cb468b9a-6b93-4eab-ac6a-6ff9771fd61a, volume: 52283c85-1eed-43b9-ad68-c764d32bdfb3, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5674e7f6-afa5-4cef-b1e2-8e52a905494d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:46 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a Sep 28 18:21:46 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:46 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" returned: 0 in 0.589s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49c440c5-6f73-4d86-a593-8bdd0df17935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab606c-ce5a-4a03-9468-f11939215eaa]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Acquiring lock "cinder-ec0381af-9da6-4018-a260-c7c0c734bb7c-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Lock "cinder-ec0381af-9da6-4018-a260-c7c0c734bb7c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:46 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 Sep 28 18:21:46 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Acquiring lock "cinder-quobyte-ec0381af-9da6-4018-a260-c7c0c734bb7c" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Lock "cinder-quobyte-ec0381af-9da6-4018-a260-c7c0c734bb7c" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a26d1e-6173-4d25-b537-ffaf1ca2d4bc]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:47 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c Sep 28 18:21:47 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:47 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935" returned: 0 in 0.599s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:47 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 Sep 28 18:21:47 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:47 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c" returned: 0 in 0.621s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:47 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c Sep 28 18:21:47 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:48 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec0381af-9da6-4018-a260-c7c0c734bb7c" returned: 0 in 0.336s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Lock "cinder-quobyte-ec0381af-9da6-4018-a260-c7c0c734bb7c" released by "delete_volume" :: held 1.065s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Created reservations ['82009e3f-62f8-4444-bb3e-a1333a091985', 'd6b66492-08c0-47a0-b783-0f116ed6ed73', '8fcdafd5-e1bf-4ed6-a585-ba19e2339b92', '1e6e7fe7-6597-4775-a02b-94e3e640b7ac'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:48 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:21:48 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:49 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.608s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:49 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Deleted volume successfully. Sep 28 18:21:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0448da49-a552-4f4f-8db1-3ea19e18b820 tempest-AbsoluteLimitsTests-1013510769 None] Lock "cinder-ec0381af-9da6-4018-a260-c7c0c734bb7c-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:56 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3" returned: 0 in 9.502s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935, size 1024.00 MB, duration 9.50 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:21:56 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Converted 1024.00 MB image at 107.75 MB/s Sep 28 18:21:56 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 is being set with open permissions: ugo+rw Sep 28 18:21:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 Sep 28 18:21:56 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:57 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-52283c85-1eed-43b9-ad68-c764d32bdfb3" released by "_copy_volume_from_snapshot" :: held 11.281s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=142,cinder:INSERT=35,cinder:UPDATE=159,cinder:DELETE=8 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=170,cinder:DELETE=11,cinder:SELECT=148,cinder:INSERT=43 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a-52283c85-1eed-43b9-ad68-c764d32bdfb3" released by "_create_volume_from_snapshot" :: held 11.408s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.440s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d340ecc-4edd-43f5-9dc1-04dfc137cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52283c85-1eed-43b9-ad68-c764d32bdfb3', 'volume_size': 1, 'snapshot_id': 'cb468b9a-6b93-4eab-ac6a-6ff9771fd61a'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61ce3db-709b-4f30-bf81-3beaf0d0c244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Volume volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 (52283c85-1eed-43b9-ad68-c764d32bdfb3): created successfully Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61ce3db-709b-4f30-bf81-3beaf0d0c244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Flow 'volume_create_manager' (bb6f524e-806f-4241-b9d7-062f04e8aa4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:57 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c0252818-3397-48b4-9bb4-2b25be9a1802 tempest-SnapshotDependencyTests-854568453 None] Created volume successfully. Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-quobyte-49c440c5-6f73-4d86-a593-8bdd0df17935" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-49c440c5-6f73-4d86-a593-8bdd0df17935" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-quobyte-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Deleting offline snapshot cb468b9a-6b93-4eab-ac6a-6ff9771fd61a of volume 49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] snapshot_file for this snap is: volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[296104fa-8181-415f-b19c-043e47747dfe]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a Sep 28 18:21:58 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" returned: 0 in 0.618s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49c440c5-6f73-4d86-a593-8bdd0df17935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:59 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec69d2-b5a4-40e6-90e0-962b50dab259]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 Sep 28 18:21:59 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935" returned: 0 in 0.729s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a Sep 28 18:22:00 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" returned: 0 in 0.540s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a Sep 28 18:22:00 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Flow 'volume_create_manager' (a57caa74-c00e-4fd6-a560-519df14a26ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b8aa16-a853-44fe-939c-91d402d7b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b8aa16-a853-44fe-939c-91d402d7b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1966369402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457ae613-7d3b-41a7-b7a8-142ee6410bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23e936e0af4bffb0aeaeed0ec5c24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:01Z,use_quota=True,user_id='b51ac11c336a42e1b6597e2eabb7cdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2e43df-c428-4aa4-b954-d01826c8f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2e43df-c428-4aa4-b954-d01826c8f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef06ca7-c735-4684-98af-39de5d9b63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef06ca7-c735-4684-98af-39de5d9b63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457ae613-7d3b-41a7-b7a8-142ee6410bfd', 'volume_name': 'volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3d3c1d-4244-498f-bd71-52b5032d869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3d3c1d-4244-498f-bd71-52b5032d869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cafa8d0-608b-4668-9435-95029cfc1ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Volume 457ae613-7d3b-41a7-b7a8-142ee6410bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd', 'volume_size': 1} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1966369402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457ae613-7d3b-41a7-b7a8-142ee6410bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23e936e0af4bffb0aeaeed0ec5c24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:01Z,use_quota=True,user_id='b51ac11c336a42e1b6597e2eabb7cdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Creating volume 457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:01 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935.cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" returned: 0 in 0.450s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd 1073741824 Sep 28 18:22:01 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a" released by "_delete_snapshot" :: held 2.544s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-49c440c5-6f73-4d86-a593-8bdd0df17935" released by "delete_snapshot" :: held 2.594s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Created reservations ['f97b205e-e655-44ed-a416-a3f82ec48116', '67ccb590-7880-4503-a5dc-179cb894b880', 'afa57d3f-e626-4c7b-a920-9511f7f96571', 'b9d29655-fdf7-468e-b037-5f9240c6939e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Delete snapshot completed successfully. Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1daa12a9-8810-480c-bdeb-a896ffa89800 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-cb468b9a-6b93-4eab-ac6a-6ff9771fd61a-delete_snapshot" released by "delete_snapshot" :: held 2.979s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-49c440c5-6f73-4d86-a593-8bdd0df17935-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:01 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd 1073741824" returned: 0 in 0.857s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-49c440c5-6f73-4d86-a593-8bdd0df17935-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-quobyte-49c440c5-6f73-4d86-a593-8bdd0df17935" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-49c440c5-6f73-4d86-a593-8bdd0df17935" acquired by "delete_volume" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:02 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd Sep 28 18:22:02 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c6ab6d-7541-4362-a928-7b2802c0530b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 Sep 28 18:22:02 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:02 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd" returned: 0 in 0.407s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cafa8d0-608b-4668-9435-95029cfc1ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5584441-c955-42de-8435-19b84faf0e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:02 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Volume volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd (457ae613-7d3b-41a7-b7a8-142ee6410bfd): created successfully Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5584441-c955-42de-8435-19b84faf0e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Flow 'volume_create_manager' (a57caa74-c00e-4fd6-a560-519df14a26ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:02 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a979e1f9-fb25-444d-ba9f-3f6c05aad996 tempest-VolumesCloneTest-571416217 None] Created volume successfully. Sep 28 18:22:02 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935" returned: 0 in 0.578s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935 Sep 28 18:22:02 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-49c440c5-6f73-4d86-a593-8bdd0df17935" returned: 0 in 0.437s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-49c440c5-6f73-4d86-a593-8bdd0df17935" released by "delete_volume" :: held 1.126s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Created reservations ['2a386199-f8de-4174-b5c9-b9670ad5aba6', 'c158058e-895c-4be4-9a7c-8fa2ee245764', '2840f17a-11d0-431d-bc95-a1dcd20ba027', '9df20bc3-0e1b-4292-84ae-6651eca2d90e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:03 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:22:03 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.546s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Deleted volume successfully. Sep 28 18:22:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0d49c1e-71fa-42b6-a594-c493d9a49064 tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-49c440c5-6f73-4d86-a593-8bdd0df17935-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Flow 'volume_create_manager' (c3ef23ed-588e-419b-82db-a7df6c6e4f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cd79ba-0b75-47ff-9e06-039010befd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-52283c85-1eed-43b9-ad68-c764d32bdfb3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cd79ba-0b75-47ff-9e06-039010befd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1660552325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4888ec73-a395-4d85-bba7-56389a8f27e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23e936e0af4bffb0aeaeed0ec5c24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=457ae613-7d3b-41a7-b7a8-142ee6410bfd,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:04Z,use_quota=True,user_id='b51ac11c336a42e1b6597e2eabb7cdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01228853-8e23-41f9-8e24-ba759260af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01228853-8e23-41f9-8e24-ba759260af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93b59d9-36db-4876-9635-e61ffb388c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93b59d9-36db-4876-9635-e61ffb388c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4888ec73-a395-4d85-bba7-56389a8f27e3', 'volume_name': 'volume-4888ec73-a395-4d85-bba7-56389a8f27e3', 'volume_size': 2, 'source_volid': '457ae613-7d3b-41a7-b7a8-142ee6410bfd', 'source_volstatus': 'available'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf61bd8a-b145-4cb7-b80d-cd181ce57af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf61bd8a-b145-4cb7-b80d-cd181ce57af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5243d104-8d35-4e81-a05f-50522dab555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Volume 4888ec73-a395-4d85-bba7-56389a8f27e3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4888ec73-a395-4d85-bba7-56389a8f27e3', 'volume_size': 2, 'source_volid': '457ae613-7d3b-41a7-b7a8-142ee6410bfd', 'source_volstatus': 'available'} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-52283c85-1eed-43b9-ad68-c764d32bdfb3-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:04 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Cloning volume 457ae613-7d3b-41a7-b7a8-142ee6410bfd to volume 4888ec73-a395-4d85-bba7-56389a8f27e3 Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Creating offline snapshot 02fb8bb6-3b4e-4536-9c0e-c6a41294eeff of volume 457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "cinder-quobyte-52283c85-1eed-43b9-ad68-c764d32bdfb3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c8b672-258d-4dfc-9341-edc531d66ffb]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-52283c85-1eed-43b9-ad68-c764d32bdfb3" acquired by "delete_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e8ab2-f150-4232-820c-1cd4bc85a905]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:04 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd Sep 28 18:22:04 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:04 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 Sep 28 18:22:04 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd" returned: 0 in 0.633s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff 1G Sep 28 18:22:05 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3" returned: 0 in 0.629s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3 Sep 28 18:22:05 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52283c85-1eed-43b9-ad68-c764d32bdfb3" returned: 0 in 0.480s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-quobyte-52283c85-1eed-43b9-ad68-c764d32bdfb3" released by "delete_volume" :: held 1.206s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:05 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff 1G" returned: 0 in 0.699s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff Sep 28 18:22:05 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Created reservations ['d4ba4ac7-b744-4fa2-ae25-8c7432a79dbd', '4390265a-b31a-481d-8553-ab26f09a3a5a', '3d281188-e620-4fd3-ab6d-a0ce5ce0243b', '635d7a84-5a88-4387-8d81-c55db53e147b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:22:06 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" returned: 0 in 0.582s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff is being set with open permissions: ugo+rw Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff Sep 28 18:22:06 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.420s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:06 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Deleted volume successfully. Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8787abd-cd42-492f-ae60-b641a6f1fbeb tempest-SnapshotDependencyTests-854568453 None] Lock "cinder-52283c85-1eed-43b9-ad68-c764d32bdfb3-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:06 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" returned: 0 in 0.509s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.info Sep 28 18:22:07 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.info" returned: 0 in 0.489s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.info is being set with open permissions: ugo+rw Sep 28 18:22:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.info Sep 28 18:22:07 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.info" returned: 0 in 0.369s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Acquiring lock "cinder-quobyte-4888ec73-a395-4d85-bba7-56389a8f27e3" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-4888ec73-a395-4d85-bba7-56389a8f27e3" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] snapshot: 02fb8bb6-3b4e-4536-9c0e-c6a41294eeff, volume: 4888ec73-a395-4d85-bba7-56389a8f27e3, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dcb5f4-6ce2-4a92-b3e1-b0ecf8998d26]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff Sep 28 18:22:08 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:08 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" returned: 0 in 0.713s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad3d8e4-e81a-4561-a598-67cc73ad90ed]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd Sep 28 18:22:08 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:09 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd" returned: 0 in 0.626s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:22:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:22:09 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:22:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:09 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 Sep 28 18:22:09 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:17 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:17 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:20 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3" returned: 0 in 10.793s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd, size 1024.00 MB, duration 10.80 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:20 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Converted 1024.00 MB image at 94.85 MB/s Sep 28 18:22:20 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 is being set with open permissions: ugo+rw Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:20 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 Sep 28 18:22:20 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:20 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3" returned: 0 in 0.390s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-4888ec73-a395-4d85-bba7-56389a8f27e3" released by "_copy_volume_from_snapshot" :: held 12.676s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Acquiring lock "cinder-quobyte-02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Deleting offline snapshot 02fb8bb6-3b4e-4536-9c0e-c6a41294eeff of volume 457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] snapshot_file for this snap is: volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5287bb-02b8-4068-8b85-0077c2f09aee]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:20 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff Sep 28 18:22:20 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:21 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" returned: 0 in 0.702s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b560e8-cc91-4710-866b-f4cf68bdae5f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:21 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd Sep 28 18:22:21 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:22 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd" returned: 0 in 0.893s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:22 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff Sep 28 18:22:22 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:22 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" returned: 0 in 0.559s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:23 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff Sep 28 18:22:23 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:23 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd.02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-02fb8bb6-3b4e-4536-9c0e-c6a41294eeff" released by "_delete_snapshot" :: held 2.757s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.062s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5243d104-8d35-4e81-a05f-50522dab555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4888ec73-a395-4d85-bba7-56389a8f27e3', 'volume_size': 2, 'source_volid': '457ae613-7d3b-41a7-b7a8-142ee6410bfd', 'source_volstatus': 'available'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db114b07-267d-4f8f-aab7-006c54f66e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:23 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Volume volume-4888ec73-a395-4d85-bba7-56389a8f27e3 (4888ec73-a395-4d85-bba7-56389a8f27e3): created successfully Sep 28 18:22:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db114b07-267d-4f8f-aab7-006c54f66e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Flow 'volume_create_manager' (c3ef23ed-588e-419b-82db-a7df6c6e4f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ee4d6a68-d47a-4401-980e-9e1bf148d163 tempest-VolumesCloneTest-571416217 None] Created volume successfully. Sep 28 18:22:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Acquiring lock "cinder-4888ec73-a395-4d85-bba7-56389a8f27e3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Lock "cinder-4888ec73-a395-4d85-bba7-56389a8f27e3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Acquiring lock "cinder-quobyte-4888ec73-a395-4d85-bba7-56389a8f27e3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-4888ec73-a395-4d85-bba7-56389a8f27e3" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7948cbf4-7988-4517-b648-c6e4264bad42]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:25 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 Sep 28 18:22:25 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3" returned: 0 in 0.498s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3 Sep 28 18:22:26 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:26 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4888ec73-a395-4d85-bba7-56389a8f27e3" returned: 0 in 0.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-4888ec73-a395-4d85-bba7-56389a8f27e3" released by "delete_volume" :: held 0.983s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Created reservations ['bef632ba-5ae3-42b8-9607-27c8900ea236', '2bf091f6-5009-4647-bd7f-a7ea5f876803', '04b8018a-a96b-4d84-9c57-01e9a750a2f5', '76d75397-246d-44cd-8ad5-d1212e32e92b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:26 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:22:26 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:27 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.389s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:27 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Deleted volume successfully. Sep 28 18:22:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1455d687-8312-4155-839c-aa57ca12a8ba tempest-VolumesCloneTest-571416217 None] Lock "cinder-4888ec73-a395-4d85-bba7-56389a8f27e3-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Acquiring lock "cinder-457ae613-7d3b-41a7-b7a8-142ee6410bfd-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Lock "cinder-457ae613-7d3b-41a7-b7a8-142ee6410bfd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Acquiring lock "cinder-quobyte-457ae613-7d3b-41a7-b7a8-142ee6410bfd" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-457ae613-7d3b-41a7-b7a8-142ee6410bfd" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e38c7e3-db39-4677-81d2-11cbca883779]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd Sep 28 18:22:28 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:28 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd" returned: 0 in 0.611s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:28 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd Sep 28 18:22:28 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-457ae613-7d3b-41a7-b7a8-142ee6410bfd" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Lock "cinder-quobyte-457ae613-7d3b-41a7-b7a8-142ee6410bfd" released by "delete_volume" :: held 1.160s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Created reservations ['d2690321-2630-4b57-a701-9d8e64d9d7ea', '80396017-401f-455d-8dff-f5eb9a6f94ac', '4ba42547-a110-42aa-a89a-95b442ed26cb', 'ba3d2680-6d19-47a0-8a88-3f9f11bc6499'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:22:29 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.365s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:29 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Deleted volume successfully. Sep 28 18:22:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f2bc49e4-0745-4b74-98fe-290c18026caa tempest-VolumesCloneTest-571416217 None] Lock "cinder-457ae613-7d3b-41a7-b7a8-142ee6410bfd-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Flow 'volume_create_manager' (782cca97-2222-459c-8f1e-96fd62f4353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25516145-e5e4-4a56-8d0a-6d6d5ba26f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25516145-e5e4-4a56-8d0a-6d6d5ba26f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-219831748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b08da28-6133-46f3-9758-94d65f5871e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dbed42ed4d475b9feeb3d0617277d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:32Z,use_quota=True,user_id='bc138dd292a04a7c8f6eb5d136c16077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb26ba4-a7c3-4fa8-bbe8-d986712f7cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb26ba4-a7c3-4fa8-bbe8-d986712f7cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ba8fc0-dec1-4f90-a1dd-1dfd241be467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ba8fc0-dec1-4f90-a1dd-1dfd241be467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b08da28-6133-46f3-9758-94d65f5871e9', 'volume_name': 'volume-6b08da28-6133-46f3-9758-94d65f5871e9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc2c33a-05f8-45f1-8012-712f4ad6b0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc2c33a-05f8-45f1-8012-712f4ad6b0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284739fc-48cd-4671-90d0-79278f8555aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Volume 6b08da28-6133-46f3-9758-94d65f5871e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b08da28-6133-46f3-9758-94d65f5871e9', 'volume_size': 1} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-219831748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b08da28-6133-46f3-9758-94d65f5871e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42dbed42ed4d475b9feeb3d0617277d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:32Z,use_quota=True,user_id='bc138dd292a04a7c8f6eb5d136c16077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Creating volume 6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:32 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:22:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 1073741824 Sep 28 18:22:32 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:32 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 1073741824" returned: 0 in 0.764s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 Sep 28 18:22:32 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:33 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9" returned: 0 in 0.305s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284739fc-48cd-4671-90d0-79278f8555aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b08da28-6133-46f3-9758-94d65f5871e9', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c7f870-8829-4b09-b557-3a7bc3370ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:33 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Volume volume-6b08da28-6133-46f3-9758-94d65f5871e9 (6b08da28-6133-46f3-9758-94d65f5871e9): created successfully Sep 28 18:22:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c7f870-8829-4b09-b557-3a7bc3370ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Flow 'volume_create_manager' (782cca97-2222-459c-8f1e-96fd62f4353c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9d4e26eb-ec26-4bab-9117-3ea25b5dccbd tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Created volume successfully. Sep 28 18:22:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Creating offline snapshot 5c66ccef-b817-41ec-af19-cccd04be1f25 of volume 6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:22:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbca225-1877-4d77-868e-a7c5c2ee0f93]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:34 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 Sep 28 18:22:34 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:34 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9" returned: 0 in 0.555s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:35 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 1G Sep 28 18:22:35 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:35 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 1G" returned: 0 in 0.920s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b08da28-6133-46f3-9758-94d65f5871e9 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:35 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b08da28-6133-46f3-9758-94d65f5871e9 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 Sep 28 18:22:35 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:36 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b08da28-6133-46f3-9758-94d65f5871e9 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25" returned: 0 in 0.410s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 is being set with open permissions: ugo+rw Sep 28 18:22:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:36 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 Sep 28 18:22:36 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:36 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25" returned: 0 in 0.296s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:36 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.info Sep 28 18:22:36 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:37 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.info" returned: 0 in 0.364s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:37 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.info is being set with open permissions: ugo+rw Sep 28 18:22:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:37 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.info Sep 28 18:22:37 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:37 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.info" returned: 0 in 0.336s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.044s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f8f7f42d-40ba-4dea-841c-e084ee5ac53c tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Create snapshot completed successfully Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "cinder-5c66ccef-b817-41ec-af19-cccd04be1f25-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-5c66ccef-b817-41ec-af19-cccd04be1f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "cinder-quobyte-6b08da28-6133-46f3-9758-94d65f5871e9" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-quobyte-6b08da28-6133-46f3-9758-94d65f5871e9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "cinder-quobyte-5c66ccef-b817-41ec-af19-cccd04be1f25" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-quobyte-5c66ccef-b817-41ec-af19-cccd04be1f25" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Deleting offline snapshot 5c66ccef-b817-41ec-af19-cccd04be1f25 of volume 6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] snapshot_file for this snap is: volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b970a58-f991-4cc9-986a-e5d4e0434bbe]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:38 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 Sep 28 18:22:38 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:38 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:22:38 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:38 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25" returned: 0 in 0.532s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b08da28-6133-46f3-9758-94d65f5871e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8198d6c-8048-48d0-a142-7273ac73b51c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:39 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 Sep 28 18:22:39 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:39 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.357s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:22:39 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9" returned: 0 in 0.514s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:39 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 Sep 28 18:22:39 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:39 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25" returned: 0 in 0.501s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:39 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25 Sep 28 18:22:40 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:40 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9.5c66ccef-b817-41ec-af19-cccd04be1f25" returned: 0 in 0.301s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-quobyte-5c66ccef-b817-41ec-af19-cccd04be1f25" released by "_delete_snapshot" :: held 1.992s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-quobyte-6b08da28-6133-46f3-9758-94d65f5871e9" released by "delete_snapshot" :: held 2.032s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:40 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Created reservations ['63a7f23a-28d6-405c-a6cb-a42cf0047e06', '547b270a-3d62-4fcf-a83c-fbf321e85182', '285d40ec-648a-46ed-8f63-fe553d98833e', 'a162302b-5365-4cc3-887c-a6d8c974a1a7'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Delete snapshot completed successfully. Sep 28 18:22:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8c4f2d1-9be4-4244-9afb-d223a082a9fc tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-5c66ccef-b817-41ec-af19-cccd04be1f25-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Flow 'volume_create_manager' (8703231f-bedb-4ce0-b695-ade7c5c1f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0996d5-496c-4988-8dab-f0172a167623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0996d5-496c-4988-8dab-f0172a167623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-365666255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b2b911-ea3d-41b3-8b5e-a311c9f5016b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f83222244c44b0aed50e537fe78eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:41Z,use_quota=True,user_id='e0b4bd59be1d48c4b6fd4aa7629ca9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8508e5-9686-4a7b-bc4e-11abb3efabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8508e5-9686-4a7b-bc4e-11abb3efabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cca852-4958-4570-a046-dfc65b791f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "cinder-6b08da28-6133-46f3-9758-94d65f5871e9-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-6b08da28-6133-46f3-9758-94d65f5871e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "cinder-quobyte-6b08da28-6133-46f3-9758-94d65f5871e9" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-quobyte-6b08da28-6133-46f3-9758-94d65f5871e9" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[564af7a0-5a1a-4faf-bcea-e40b24812d00]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cca852-4958-4570-a046-dfc65b791f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50b2b911-ea3d-41b3-8b5e-a311c9f5016b', 'volume_name': 'volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9399c578-3f17-442e-ab1a-b37565fbfdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9399c578-3f17-442e-ab1a-b37565fbfdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62175f13-0cc2-40ad-99e6-2711c9d04256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:41 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Volume 50b2b911-ea3d-41b3-8b5e-a311c9f5016b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:22:41 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Trying to clone 50b2b911-ea3d-41b3-8b5e-a311c9f5016b from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:22:41 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 Sep 28 18:22:41 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:22:42 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d037da-fd96-4a07-81b9-b53d1dba99b8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9" returned: 0 in 0.568s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9 Sep 28 18:22:42 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD Sep 28 18:22:42 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 is fetched for user e0b4bd59be1d48c4b6fd4aa7629ca9a7. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:22:42 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b08da28-6133-46f3-9758-94d65f5871e9" returned: 0 in 0.310s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-quobyte-6b08da28-6133-46f3-9758-94d65f5871e9" released by "delete_volume" :: held 0.960s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8343796e-85e4-4f25-a301-064c43561f84]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Created reservations ['f330ab29-3c18-4df4-82ce-c83c33366fd8', 'ac620a04-da0e-46b5-bd73-32101bdd1ab5', 'f95322d6-a04d-4780-acf5-a784eba03a28', 'a8ef147e-15b2-443c-b79f-ab0d0f51ce07'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD Sep 28 18:22:42 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:22:42 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:43 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-365666255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b2b911-ea3d-41b3-8b5e-a311c9f5016b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f83222244c44b0aed50e537fe78eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:41Z,use_quota=True,user_id='e0b4bd59be1d48c4b6fd4aa7629ca9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Creating volume 50b2b911-ea3d-41b3-8b5e-a311c9f5016b {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:43 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:43 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b 1073741824 Sep 28 18:22:43 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:43 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.474s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Deleted volume successfully. Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-19dfcd00-a077-4532-b453-08b333097c84 tempest-VolumeSnapshotQuotasNegativeTestJSON-377542699 None] Lock "cinder-6b08da28-6133-46f3-9758-94d65f5871e9-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:43 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b 1073741824" returned: 0 in 0.535s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:43 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b Sep 28 18:22:43 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:44 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b" returned: 0 in 0.332s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Attempting download of 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume 50b2b911-ea3d-41b3-8b5e-a311c9f5016b. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb91fe5-c3e8-4b9d-ab52-351f9d96b980]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_mtrf2qjd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_mtrf2qjd Sep 28 18:22:44 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:44 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_mtrf2qjd" returned: 0 in 0.418s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_mtrf2qjd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_mtrf2qjd Sep 28 18:22:44 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:45 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_mtrf2qjd" returned: 1 in 0.441s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_mtrf2qjd' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:45 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcad5c4-91b7-46e2-a917-811dde42a109]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:45 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD Sep 28 18:22:45 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:45 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:45 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] 052187e4-f9b0-4ab2-bf54-351fdb1df836 was qcow2, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:22:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:45 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b Sep 28 18:22:45 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:48 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b" returned: 0 in 2.660s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_91hf7z4ydevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:48 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Converted 112.00 MB image at 42.08 MB/s Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:48 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b 1G Sep 28 18:22:48 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:48 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b 1G" returned: 0 in 0.484s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Downloaded image 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume 50b2b911-ea3d-41b3-8b5e-a311c9f5016b successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 for user e0b4bd59be1d48c4b6fd4aa7629ca9a7 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Marking volume 50b2b911-ea3d-41b3-8b5e-a311c9f5016b as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Copying metadata from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 to 50b2b911-ea3d-41b3-8b5e-a311c9f5016b. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Creating volume glance metadata for volume 50b2b911-ea3d-41b3-8b5e-a311c9f5016b backed by image 052187e4-f9b0-4ab2-bf54-351fdb1df836 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62175f13-0cc2-40ad-99e6-2711c9d04256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e023900e-8ff6-451c-b617-e6b342a2b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:48 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Volume volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b (50b2b911-ea3d-41b3-8b5e-a311c9f5016b): created successfully Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e023900e-8ff6-451c-b617-e6b342a2b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Flow 'volume_create_manager' (8703231f-bedb-4ce0-b695-ade7c5c1f728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f88215f6-b594-48db-a73a-ca937e82fd7b tempest-TestShelveInstance-1471180316 None] Created volume successfully. Sep 28 18:22:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-0865b204-1e3e-4c02-a143-980ae15fcee0 req-01d886e9-e1a2-40ca-95e7-e304c55a00c9 tempest-TestShelveInstance-1471180316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-0865b204-1e3e-4c02-a143-980ae15fcee0 req-01d886e9-e1a2-40ca-95e7-e304c55a00c9 tempest-TestShelveInstance-1471180316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-0865b204-1e3e-4c02-a143-980ae15fcee0 req-01d886e9-e1a2-40ca-95e7-e304c55a00c9 tempest-TestShelveInstance-1471180316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:54 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-0865b204-1e3e-4c02-a143-980ae15fcee0 req-01d886e9-e1a2-40ca-95e7-e304c55a00c9 tempest-TestShelveInstance-1471180316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '138b0071-12ac-4663-9b1d-42b623bbe816', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:22:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-0865b204-1e3e-4c02-a143-980ae15fcee0 req-01d886e9-e1a2-40ca-95e7-e304c55a00c9 tempest-TestShelveInstance-1471180316 None] attachment_update completed successfully. Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Flow 'volume_create_manager' (aa673082-1d28-48d3-91cf-4d371085dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8de1cd5-b5f2-448c-9874-0d04ddb3f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8de1cd5-b5f2-448c-9874-0d04ddb3f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-995938868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d906e10-3b49-4f07-8db9-a167d7eaa3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7997bdaa03740b4a65cbdb6d1decd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:02Z,use_quota=True,user_id='f86a1eb67bdf46f9a68a478de2eb8aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517f4ebb-d5e2-462b-8b7a-7deb3dabc03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517f4ebb-d5e2-462b-8b7a-7deb3dabc03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c36876d-f19a-4860-8c1c-07f9bb4fc2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c36876d-f19a-4860-8c1c-07f9bb4fc2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d906e10-3b49-4f07-8db9-a167d7eaa3a3', 'volume_name': 'volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4370f7c2-8c6d-4fb3-aefa-c190d4eff532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4370f7c2-8c6d-4fb3-aefa-c190d4eff532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46f85bb-5ae6-419c-8b93-4a0aeb020487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:02 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Volume 3d906e10-3b49-4f07-8db9-a167d7eaa3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3', 'volume_size': 1} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-995938868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d906e10-3b49-4f07-8db9-a167d7eaa3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7997bdaa03740b4a65cbdb6d1decd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:02Z,use_quota=True,user_id='f86a1eb67bdf46f9a68a478de2eb8aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Creating volume 3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:02 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:23:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:02 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 1073741824 Sep 28 18:23:02 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:03 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 1073741824" returned: 0 in 0.871s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:03 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 Sep 28 18:23:03 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:03 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" returned: 0 in 0.433s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46f85bb-5ae6-419c-8b93-4a0aeb020487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740c50ad-8553-4580-98df-8e9d94ef7cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Volume volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 (3d906e10-3b49-4f07-8db9-a167d7eaa3a3): created successfully Sep 28 18:23:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740c50ad-8553-4580-98df-8e9d94ef7cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Flow 'volume_create_manager' (aa673082-1d28-48d3-91cf-4d371085dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9a0cd568-dcca-4c5c-bb51-7236219e0c7c tempest-VolumesDeleteCascade-1644610092 None] Created volume successfully. Sep 28 18:23:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Creating offline snapshot 464889b3-a30a-4905-b79a-3635b0cf0202 of volume 3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:23:05 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2478fd91-b819-4576-9b6a-d5b1b97fb3b6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:05 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 Sep 28 18:23:05 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:05 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" returned: 0 in 0.885s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:06 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 1G Sep 28 18:23:06 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:06 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 1G" returned: 0 in 0.700s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:06 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 Sep 28 18:23:06 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:07 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202" returned: 0 in 0.462s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:07 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 is being set with open permissions: ugo+rw Sep 28 18:23:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:07 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 Sep 28 18:23:07 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:07 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202" returned: 0 in 0.554s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:07 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.info Sep 28 18:23:07 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:08 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.info" returned: 0 in 0.402s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:08 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.info is being set with open permissions: ugo+rw Sep 28 18:23:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:08 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.info Sep 28 18:23:08 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:08 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.info" returned: 0 in 0.332s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:08 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-72e20beb-2e7c-4102-88bb-115d4fc5885d tempest-VolumesDeleteCascade-1644610092 None] Create snapshot completed successfully Sep 28 18:23:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Creating offline snapshot da309861-cf3c-4206-9f5b-1af7e9c808c7 of volume 3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:23:09 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69f675-ea55-4af7-b887-18f388da8f66]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:09 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 Sep 28 18:23:09 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:10 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202" returned: 0 in 0.584s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:10 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 1G Sep 28 18:23:10 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:10 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:10 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Flow 'volume_create_manager' (8c95db18-2b45-4538-8ed1-010ee09da963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4ebb6f-8113-4a2a-8e98-abb2522221b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 1G" returned: 0 in 0.714s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4ebb6f-8113-4a2a-8e98-abb2522221b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-896939485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10de1a5-ad34-47ce-b581-36e23beef2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f82dc1b8b5141f0b8bd7ad5e61fc04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:11Z,use_quota=True,user_id='293a60f696af45a291687cdb34cbcdcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5966fbf2-7b03-41a0-98e4-50db87bc2f02),volume_type_id=5966fbf2-7b03-41a0-98e4-50db87bc2f02)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdeefbe-43b7-4596-a01d-f75ac94c53b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 Sep 28 18:23:11 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdeefbe-43b7-4596-a01d-f75ac94c53b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b324b0bc-7f1d-4781-bbf3-9ef2246f6ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b324b0bc-7f1d-4781-bbf3-9ef2246f6ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10de1a5-ad34-47ce-b581-36e23beef2c7', 'volume_name': 'volume-e10de1a5-ad34-47ce-b581-36e23beef2c7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbdb634-d8b8-4bc7-9e14-ae235f5bdb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbdb634-d8b8-4bc7-9e14-ae235f5bdb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a0f512-40ae-43dd-9467-da855e5591bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Volume e10de1a5-ad34-47ce-b581-36e23beef2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10de1a5-ad34-47ce-b581-36e23beef2c7', 'volume_size': 1} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:11 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7" returned: 0 in 0.408s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:11 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 is being set with open permissions: ugo+rw Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:11 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 Sep 28 18:23:11 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Flow 'volume_create_manager' (a597bf17-7d71-4dfc-909f-0140a333b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadcde66-5b17-47a5-a0a0-67d032e88708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadcde66-5b17-47a5-a0a0-67d032e88708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1249256054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405aa97c-e101-49b1-8850-31fe4391bef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f82dc1b8b5141f0b8bd7ad5e61fc04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:11Z,use_quota=True,user_id='293a60f696af45a291687cdb34cbcdcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(586c5653-6594-4b5b-bb1c-42620291e6ee),volume_type_id=586c5653-6594-4b5b-bb1c-42620291e6ee)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d513497-8bbc-4f7f-8534-1f82e9d277ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d513497-8bbc-4f7f-8534-1f82e9d277ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80b6c42-451d-4bb4-ad3c-990203921208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80b6c42-451d-4bb4-ad3c-990203921208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405aa97c-e101-49b1-8850-31fe4391bef2', 'volume_name': 'volume-405aa97c-e101-49b1-8850-31fe4391bef2', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2d1424-14ef-4215-8e85-b5adad1d8bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2d1424-14ef-4215-8e85-b5adad1d8bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9d986d-ae43-451c-b7fe-963d4a201f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Volume 405aa97c-e101-49b1-8850-31fe4391bef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405aa97c-e101-49b1-8850-31fe4391bef2', 'volume_size': 1} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:11 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7" returned: 0 in 0.326s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-896939485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10de1a5-ad34-47ce-b581-36e23beef2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f82dc1b8b5141f0b8bd7ad5e61fc04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:11Z,use_quota=True,user_id='293a60f696af45a291687cdb34cbcdcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5966fbf2-7b03-41a0-98e4-50db87bc2f02),volume_type_id=5966fbf2-7b03-41a0-98e4-50db87bc2f02)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Creating volume e10de1a5-ad34-47ce-b581-36e23beef2c7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:11 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:23:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:11 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 1073741824 Sep 28 18:23:11 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-722c1bf9-3509-47a9-bf96-e09233975f29 tempest-VolumesDeleteCascade-1644610092 None] Create snapshot completed successfully Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Flow 'volume_create_manager' (46cc4847-0ae9-4080-a667-2fbc7cde7905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5f2956-1285-4bcc-beac-cea7c4ca927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5f2956-1285-4bcc-beac-cea7c4ca927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-546474912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e506e90-cf67-4e52-9d94-221ec0562054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f82dc1b8b5141f0b8bd7ad5e61fc04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:12Z,use_quota=True,user_id='293a60f696af45a291687cdb34cbcdcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c51faf2c-b11d-41ae-89c4-ba4a8a599d10),volume_type_id=c51faf2c-b11d-41ae-89c4-ba4a8a599d10)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0570ce-3b63-4a47-ae09-6a9735823ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0570ce-3b63-4a47-ae09-6a9735823ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e627a5bb-ca3c-45f9-b78e-6da8f3089f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:23:12 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 1073741824" returned: 0 in 0.526s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:12 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 Sep 28 18:23:12 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e627a5bb-ca3c-45f9-b78e-6da8f3089f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e506e90-cf67-4e52-9d94-221ec0562054', 'volume_name': 'volume-2e506e90-cf67-4e52-9d94-221ec0562054', 'volume_size': 1, 'image_id': 'b51284d4-2e76-4a16-a88d-8a78ac599566', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b51284d4-2e76-4a16-a88d-8a78ac599566', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1067134751', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f82dc1b8b5141f0b8bd7ad5e61fc04e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b51284d4-2e76-4a16-a88d-8a78ac599566', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b51284d4-2e76-4a16-a88d-8a78ac599566/file', 'properties': {}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f98c779-6b4b-4e0f-a4d3-b45f203ae748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f98c779-6b4b-4e0f-a4d3-b45f203ae748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8749dfe-409b-4775-a980-08fe6428c96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:12 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Volume 2e506e90-cf67-4e52-9d94-221ec0562054: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e506e90-cf67-4e52-9d94-221ec0562054', 'volume_size': 1, 'image_id': 'b51284d4-2e76-4a16-a88d-8a78ac599566', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b51284d4-2e76-4a16-a88d-8a78ac599566', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1067134751', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f82dc1b8b5141f0b8bd7ad5e61fc04e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b51284d4-2e76-4a16-a88d-8a78ac599566', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b51284d4-2e76-4a16-a88d-8a78ac599566/file', 'properties': {}}, 'image_service': } Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Trying to clone 2e506e90-cf67-4e52-9d94-221ec0562054 from image b51284d4-2e76-4a16-a88d-8a78ac599566 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b51284d4-2e76-4a16-a88d-8a78ac599566', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:23:12 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7" returned: 0 in 0.352s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1249256054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405aa97c-e101-49b1-8850-31fe4391bef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f82dc1b8b5141f0b8bd7ad5e61fc04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:11Z,use_quota=True,user_id='293a60f696af45a291687cdb34cbcdcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(586c5653-6594-4b5b-bb1c-42620291e6ee),volume_type_id=586c5653-6594-4b5b-bb1c-42620291e6ee)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Creating volume 405aa97c-e101-49b1-8850-31fe4391bef2 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:12 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:12 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 1073741824 Sep 28 18:23:12 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a0f512-40ae-43dd-9467-da855e5591bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10de1a5-ad34-47ce-b581-36e23beef2c7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7676dd39-2127-4e2b-b810-a223fec2fa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-3d906e10-3b49-4f07-8db9-a167d7eaa3a3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:12 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Volume volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 (e10de1a5-ad34-47ce-b581-36e23beef2c7): created successfully Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7676dd39-2127-4e2b-b810-a223fec2fa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Flow 'volume_create_manager' (8c95db18-2b45-4538-8ed1-010ee09da963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-3d906e10-3b49-4f07-8db9-a167d7eaa3a3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:12 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c8532aae-16f3-4800-8138-68a7944d0b1f tempest-TestInstancesWithCinderVolumes-175962132 None] Created volume successfully. Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Performing cascade delete. {{(pid=86981) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-464889b3-a30a-4905-b79a-3635b0cf0202-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-464889b3-a30a-4905-b79a-3635b0cf0202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-464889b3-a30a-4905-b79a-3635b0cf0202" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-464889b3-a30a-4905-b79a-3635b0cf0202" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Deleting offline snapshot 464889b3-a30a-4905-b79a-3635b0cf0202 of volume 3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] snapshot_file for this snap is: volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c2c40-0981-4a06-83e8-1ea16c0be6fd]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:13 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 Sep 28 18:23:13 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:13 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 1073741824" returned: 0 in 0.711s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:13 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 Sep 28 18:23:13 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:13 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202" returned: 0 in 0.475s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a42c42c-8274-477e-87fb-f47457fa50f3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:13 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 Sep 28 18:23:13 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:13 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9d986d-ae43-451c-b7fe-963d4a201f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405aa97c-e101-49b1-8850-31fe4391bef2', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba782b6-b136-4f08-b245-9e6d9dee421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Volume volume-405aa97c-e101-49b1-8850-31fe4391bef2 (405aa97c-e101-49b1-8850-31fe4391bef2): created successfully Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba782b6-b136-4f08-b245-9e6d9dee421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Flow 'volume_create_manager' (a597bf17-7d71-4dfc-909f-0140a333b483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1871c81e-3d3a-4a42-898b-19d709b9823a tempest-TestInstancesWithCinderVolumes-175962132 None] Created volume successfully. Sep 28 18:23:14 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" returned: 0 in 0.497s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:14 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3afcf55-ca6d-46ea-9d2e-bfd35b24306e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:14 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 Sep 28 18:23:14 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:14 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7" returned: 0 in 0.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:14 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd573c86-500a-4483-86ab-5057948e87de]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:14 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 Sep 28 18:23:14 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:15 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202" returned: 0 in 0.447s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04507d6-ddb6-4d23-a790-56885a38a30a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:15 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 Sep 28 18:23:15 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:15 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" returned: 0 in 0.501s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:15 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 Sep 28 18:23:15 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:16 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202" returned: 0 in 0.412s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:16 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202 Sep 28 18:23:16 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:16 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.464889b3-a30a-4905-b79a-3635b0cf0202" returned: 0 in 0.399s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 -F qcow2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:16 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 -F qcow2 Sep 28 18:23:16 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD, size 20.69 MB, duration 4.15 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:23:16 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Image download 20.69 MB at 4.98 MB/s Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc83405-37f1-41dc-89f7-b8da47dc3f54]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:16 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 -F qcow2" returned: 0 in 0.340s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-464889b3-a30a-4905-b79a-3635b0cf0202" released by "_delete_snapshot" :: held 3.715s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" released by "delete_snapshot" :: held 3.747s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:16 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD Sep 28 18:23:16 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:16 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Created reservations ['0910c7d3-4bba-466a-8b1f-ecb3be0743fd', 'a486d7f4-27c5-4675-b732-8b8067393f58', '4f51e5d3-9cb3-46c6-885f-bbf97c3bce9b', '23d39248-e320-456a-a187-e51893f33d15'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Delete snapshot completed successfully. Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-464889b3-a30a-4905-b79a-3635b0cf0202-delete_snapshot" released by "delete_snapshot" :: held 3.983s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-da309861-cf3c-4206-9f5b-1af7e9c808c7-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-da309861-cf3c-4206-9f5b-1af7e9c808c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-da309861-cf3c-4206-9f5b-1af7e9c808c7" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-da309861-cf3c-4206-9f5b-1af7e9c808c7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Deleting offline snapshot da309861-cf3c-4206-9f5b-1af7e9c808c7 of volume 3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] snapshot_file for this snap is: volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[655cafd3-a7af-4844-9145-a57bd30c17ca]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:17 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Temporary image b51284d4-2e76-4a16-a88d-8a78ac599566 is fetched for user 293a60f696af45a291687cdb34cbcdcd. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=59,cinder:UPDATE=58,cinder:INSERT=20,cinder:DELETE=10 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=66,cinder:SELECT=70,cinder:INSERT=21,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c12bea6-fb8a-45fc-8a52-6a86f7e4bf55]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:17 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 Sep 28 18:23:17 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:17 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD Sep 28 18:23:17 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:17 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7" returned: 0 in 0.484s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a4df8a-260d-4fe9-b0cd-9de348dac6a4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:17 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-546474912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e506e90-cf67-4e52-9d94-221ec0562054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f82dc1b8b5141f0b8bd7ad5e61fc04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:12Z,use_quota=True,user_id='293a60f696af45a291687cdb34cbcdcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c51faf2c-b11d-41ae-89c4-ba4a8a599d10),volume_type_id=c51faf2c-b11d-41ae-89c4-ba4a8a599d10)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Creating volume 2e506e90-cf67-4e52-9d94-221ec0562054 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:17 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:23:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:17 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 1073741824 Sep 28 18:23:17 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:17 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 Sep 28 18:23:17 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:18 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" returned: 0 in 0.430s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:18 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 Sep 28 18:23:18 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:18 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 1073741824" returned: 0 in 0.480s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:18 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 Sep 28 18:23:18 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:18 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7" returned: 0 in 0.383s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:18 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7 Sep 28 18:23:18 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:18 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054" returned: 0 in 0.295s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Attempting download of b51284d4-2e76-4a16-a88d-8a78ac599566 ((None, [{'url': 'file:///opt/stack/data/glance/images/b51284d4-2e76-4a16-a88d-8a78ac599566', 'metadata': {}}])) to volume 2e506e90-cf67-4e52-9d94-221ec0562054. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea66a3-1e32-47af-981f-50b1751c6891]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b51284d4-2e76-4a16-a88d-8a78ac599566__cufdtmn {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:18 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3.da309861-cf3c-4206-9f5b-1af7e9c808c7" returned: 0 in 0.332s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:18 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b51284d4-2e76-4a16-a88d-8a78ac599566__cufdtmn Sep 28 18:23:18 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-da309861-cf3c-4206-9f5b-1af7e9c808c7" released by "_delete_snapshot" :: held 1.751s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" released by "delete_snapshot" :: held 1.777s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:18 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Created reservations ['d8fcd478-880f-4e1b-a19b-03c67a802fa9', 'bb32c42f-734a-4158-9ad6-025e83216e76', 'f2c0bc6e-1a6b-42f9-824e-539e8447e4a7', '0f5809f9-0d62-4746-994b-464c9b5202ae'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Delete snapshot completed successfully. Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-da309861-cf3c-4206-9f5b-1af7e9c808c7-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Snapshots deleted, issuing volume delete {{(pid=86981) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b3863-6cad-4c53-a3c3-3c5775f6a2b6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:19 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b51284d4-2e76-4a16-a88d-8a78ac599566__cufdtmn" returned: 0 in 0.467s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b51284d4-2e76-4a16-a88d-8a78ac599566__cufdtmn {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:19 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 Sep 28 18:23:19 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:19 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b51284d4-2e76-4a16-a88d-8a78ac599566__cufdtmn Sep 28 18:23:19 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:19 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b51284d4-2e76-4a16-a88d-8a78ac599566__cufdtmn" returned: 1 in 0.410s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b51284d4-2e76-4a16-a88d-8a78ac599566__cufdtmn' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f836d-b84b-49ec-a5c2-adaa0cc4ad62]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:19 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:19 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3 Sep 28 18:23:19 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:19 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD Sep 28 18:23:19 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:19 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" returned: 0 in 0.292s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-3d906e10-3b49-4f07-8db9-a167d7eaa3a3" released by "delete_volume" :: held 0.837s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:19 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] b51284d4-2e76-4a16-a88d-8a78ac599566 was qcow2, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:23:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:19 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 Sep 28 18:23:19 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Created reservations ['9d04c41f-ff9c-4272-a5e6-78b8efdf2f99', 'c952b83c-2495-4fc9-8331-da20d48a356e', '52e235e5-6326-4292-98d8-9aa6df7959cb', '470c296a-2f47-43bb-92af-e95f4a26c1fc'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:20 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:23:20 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:20 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.311s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:20 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Deleted volume successfully. Sep 28 18:23:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a917353d-3e0e-4571-82a6-20b5fd6c9638 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-3d906e10-3b49-4f07-8db9-a167d7eaa3a3-delete_volume" released by "delete_volume" :: held 7.514s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Flow 'volume_create_manager' (886ca629-d290-476e-9db0-8d70760d8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cb170e-a465-487e-a88f-ffc7b4738462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cb170e-a465-487e-a88f-ffc7b4738462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-278110569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7997bdaa03740b4a65cbdb6d1decd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:22Z,use_quota=True,user_id='f86a1eb67bdf46f9a68a478de2eb8aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124e54a8-a603-4527-9278-c565ba9e25e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124e54a8-a603-4527-9278-c565ba9e25e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1eea0f-3498-4eab-9789-159af50eb5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1eea0f-3498-4eab-9789-159af50eb5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1', 'volume_name': 'volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7780dd3-0a0f-49b0-ac09-6ad93cdf3ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7780dd3-0a0f-49b0-ac09-6ad93cdf3ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da3494-9451-47a1-adbf-335b0a23ffe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:21 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Volume 02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1', 'volume_size': 1} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-278110569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7997bdaa03740b4a65cbdb6d1decd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:22Z,use_quota=True,user_id='f86a1eb67bdf46f9a68a478de2eb8aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Creating volume 02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:21 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:23:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:21 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 1073741824 Sep 28 18:23:21 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:22 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 1073741824" returned: 0 in 0.589s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:22 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054" returned: 0 in 2.489s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b51284d4-2e76-4a16-a88d-8a78ac599566_0jxfb3qudevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:23:22 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Converted 112.00 MB image at 44.98 MB/s Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:22 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 1G Sep 28 18:23:22 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:22 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 Sep 28 18:23:22 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:22 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" returned: 0 in 0.278s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da3494-9451-47a1-adbf-335b0a23ffe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc05ec93-da23-4988-b444-4275508b2520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:22 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Volume volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 (02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1): created successfully Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc05ec93-da23-4988-b444-4275508b2520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Flow 'volume_create_manager' (886ca629-d290-476e-9db0-8d70760d8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:22 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 1G" returned: 0 in 0.381s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Downloaded image b51284d4-2e76-4a16-a88d-8a78ac599566 ((None, [{'url': 'file:///opt/stack/data/glance/images/b51284d4-2e76-4a16-a88d-8a78ac599566', 'metadata': {}}])) to volume 2e506e90-cf67-4e52-9d94-221ec0562054 successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Temporary image b51284d4-2e76-4a16-a88d-8a78ac599566 for user 293a60f696af45a291687cdb34cbcdcd is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Marking volume 2e506e90-cf67-4e52-9d94-221ec0562054 as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:23:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4d0e10c1-625b-403d-b59b-46d1def5bab5 tempest-VolumesDeleteCascade-1644610092 None] Created volume successfully. Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Copying metadata from image b51284d4-2e76-4a16-a88d-8a78ac599566 to 2e506e90-cf67-4e52-9d94-221ec0562054. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Creating volume glance metadata for volume 2e506e90-cf67-4e52-9d94-221ec0562054 backed by image b51284d4-2e76-4a16-a88d-8a78ac599566 with: {'image_id': 'b51284d4-2e76-4a16-a88d-8a78ac599566', 'image_name': 'tempest-scenario-img--1067134751', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8749dfe-409b-4775-a980-08fe6428c96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e506e90-cf67-4e52-9d94-221ec0562054', 'volume_size': 1, 'image_id': 'b51284d4-2e76-4a16-a88d-8a78ac599566', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b51284d4-2e76-4a16-a88d-8a78ac599566', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1067134751', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f82dc1b8b5141f0b8bd7ad5e61fc04e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b51284d4-2e76-4a16-a88d-8a78ac599566', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b51284d4-2e76-4a16-a88d-8a78ac599566/file', 'properties': {}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184eb869-0e26-414d-a120-1530be09094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:22 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Volume volume-2e506e90-cf67-4e52-9d94-221ec0562054 (2e506e90-cf67-4e52-9d94-221ec0562054): created successfully Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184eb869-0e26-414d-a120-1530be09094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Flow 'volume_create_manager' (46cc4847-0ae9-4080-a667-2fbc7cde7905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e202b2bd-7c30-4a46-8ff4-d69faf702fc3 tempest-TestInstancesWithCinderVolumes-175962132 None] Created volume successfully. Sep 28 18:23:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Creating offline snapshot 2cb13374-afed-4345-966a-2c0fd11b5a39 of volume 02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:23:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e924c3f-f38c-492d-9e3b-a77218f6e255]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:24 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 Sep 28 18:23:24 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:24 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" returned: 0 in 0.411s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:24 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 1G Sep 28 18:23:24 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:24 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 1G" returned: 0 in 0.478s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:24 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 Sep 28 18:23:24 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:25 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:25 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 is being set with open permissions: ugo+rw Sep 28 18:23:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:25 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 Sep 28 18:23:25 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:25 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39" returned: 0 in 0.272s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:25 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.info Sep 28 18:23:25 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:25 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.info" returned: 0 in 0.291s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:25 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.info is being set with open permissions: ugo+rw Sep 28 18:23:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:25 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.info Sep 28 18:23:25 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:26 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.info" returned: 0 in 0.316s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-bbb19680-2b26-438b-8d7a-2238f240b85d tempest-VolumesDeleteCascade-1644610092 None] Create snapshot completed successfully Sep 28 18:23:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-88630115-883a-4906-9117-8cf316394870 req-a385b8d5-6bb3-4a90-955a-68158aaf2466 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-88630115-883a-4906-9117-8cf316394870 req-a385b8d5-6bb3-4a90-955a-68158aaf2466 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-88630115-883a-4906-9117-8cf316394870 req-a385b8d5-6bb3-4a90-955a-68158aaf2466 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-88630115-883a-4906-9117-8cf316394870 req-a385b8d5-6bb3-4a90-955a-68158aaf2466 tempest-TestInstancesWithCinderVolumes-175962132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-2e506e90-cf67-4e52-9d94-221ec0562054', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44904b4e-f5df-4228-be77-75927941af99', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:23:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-88630115-883a-4906-9117-8cf316394870 req-a385b8d5-6bb3-4a90-955a-68158aaf2466 tempest-TestInstancesWithCinderVolumes-175962132 None] attachment_update completed successfully. Sep 28 18:23:27 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Flow 'volume_create_manager' (9c8e68d0-3f1e-44a5-9ab8-a89d6b2a9c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad6bd51-7f64-4dd4-a5c4-d233619a1e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad6bd51-7f64-4dd4-a5c4-d233619a1e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-267537962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277cf9bf-c498-4e94-b3db-bac630fc992e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7997bdaa03740b4a65cbdb6d1decd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2cb13374-afed-4345-966a-2c0fd11b5a39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:28Z,use_quota=True,user_id='f86a1eb67bdf46f9a68a478de2eb8aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdaa301-a946-49d6-8b95-25e08f450558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdaa301-a946-49d6-8b95-25e08f450558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3453bed-f63c-4b0e-bc2a-f5e13580eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3453bed-f63c-4b0e-bc2a-f5e13580eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '277cf9bf-c498-4e94-b3db-bac630fc992e', 'volume_name': 'volume-277cf9bf-c498-4e94-b3db-bac630fc992e', 'volume_size': 1, 'snapshot_id': '2cb13374-afed-4345-966a-2c0fd11b5a39'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7733d9-0878-49f8-b3d6-cde7799635b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7733d9-0878-49f8-b3d6-cde7799635b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7addc56-5032-4d84-9b22-5b023874019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Volume 277cf9bf-c498-4e94-b3db-bac630fc992e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-277cf9bf-c498-4e94-b3db-bac630fc992e', 'volume_size': 1, 'snapshot_id': '2cb13374-afed-4345-966a-2c0fd11b5a39'} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-2cb13374-afed-4345-966a-2c0fd11b5a39-277cf9bf-c498-4e94-b3db-bac630fc992e" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-2cb13374-afed-4345-966a-2c0fd11b5a39-277cf9bf-c498-4e94-b3db-bac630fc992e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Creating volume 277cf9bf-c498-4e94-b3db-bac630fc992e from snapshot 2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-277cf9bf-c498-4e94-b3db-bac630fc992e" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-277cf9bf-c498-4e94-b3db-bac630fc992e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] snapshot: 2cb13374-afed-4345-966a-2c0fd11b5a39, volume: 277cf9bf-c498-4e94-b3db-bac630fc992e, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[89081529-405b-44c6-aff7-a45ae09e1dc9]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:28 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 Sep 28 18:23:28 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:28 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39" returned: 0 in 0.454s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[410caa44-e6f2-4629-9978-8c4197225cd5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:28 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 Sep 28 18:23:28 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:29 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" returned: 0 in 0.483s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:23:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:23:29 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:23:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:29 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e Sep 28 18:23:29 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:37 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=29,cinder:INSERT=12,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:INSERT=8,cinder:UPDATE=23,cinder:SELECT=27,cinder:DELETE=3 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:39 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:23:39 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:39 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 1.088s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:40 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:23:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:23:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-ed288721-9020-4024-b770-c385c54acdc7 req-52b00168-d1a7-4a65-8bae-1b4bd48b1c6f tempest-TestShelveInstance-1471180316 None] Terminate volume connection completed successfully. Sep 28 18:23:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-ed288721-9020-4024-b770-c385c54acdc7 req-52b00168-d1a7-4a65-8bae-1b4bd48b1c6f tempest-TestShelveInstance-1471180316 None] Deleting attachment 138b0071-12ac-4663-9b1d-42b623bbe816. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:23:41 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e" returned: 0 in 12.714s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:41 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1, size 1024.00 MB, duration 12.72 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:23:41 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Converted 1024.00 MB image at 80.53 MB/s Sep 28 18:23:41 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e is being set with open permissions: ugo+rw Sep 28 18:23:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:41 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e Sep 28 18:23:41 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e" returned: 0 in 0.422s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-277cf9bf-c498-4e94-b3db-bac630fc992e" released by "_copy_volume_from_snapshot" :: held 14.188s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-2cb13374-afed-4345-966a-2c0fd11b5a39-277cf9bf-c498-4e94-b3db-bac630fc992e" released by "_create_volume_from_snapshot" :: held 14.286s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.305s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7addc56-5032-4d84-9b22-5b023874019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277cf9bf-c498-4e94-b3db-bac630fc992e', 'volume_size': 1, 'snapshot_id': '2cb13374-afed-4345-966a-2c0fd11b5a39'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa02f5b6-27c9-49bf-a802-9f0cf9d1cc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Volume volume-277cf9bf-c498-4e94-b3db-bac630fc992e (277cf9bf-c498-4e94-b3db-bac630fc992e): created successfully Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa02f5b6-27c9-49bf-a802-9f0cf9d1cc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Flow 'volume_create_manager' (9c8e68d0-3f1e-44a5-9ab8-a89d6b2a9c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ab9326d4-82a8-4b6d-96ad-f7c6305f2fed tempest-VolumesDeleteCascade-1644610092 None] Created volume successfully. Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Performing cascade delete. {{(pid=86981) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-2cb13374-afed-4345-966a-2c0fd11b5a39-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-2cb13374-afed-4345-966a-2c0fd11b5a39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-2cb13374-afed-4345-966a-2c0fd11b5a39" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-2cb13374-afed-4345-966a-2c0fd11b5a39" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Deleting offline snapshot 2cb13374-afed-4345-966a-2c0fd11b5a39 of volume 02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] snapshot_file for this snap is: volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31bb212-bb65-4fb2-888c-a36c3843c6b6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 Sep 28 18:23:43 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39" returned: 0 in 0.529s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:23:44 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4eb544-ceb1-4a97-856c-3ea5bc7cca57]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 Sep 28 18:23:44 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" returned: 0 in 1.074s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:45 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 Sep 28 18:23:45 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-93b6b4c4-623f-40fc-8547-7ed91cf91c17 req-14c61d71-3591-4824-b2e5-b21c6b3dc3b7 tempest-TestShelveInstance-1471180316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-93b6b4c4-623f-40fc-8547-7ed91cf91c17 req-14c61d71-3591-4824-b2e5-b21c6b3dc3b7 tempest-TestShelveInstance-1471180316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-93b6b4c4-623f-40fc-8547-7ed91cf91c17 req-14c61d71-3591-4824-b2e5-b21c6b3dc3b7 tempest-TestShelveInstance-1471180316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-93b6b4c4-623f-40fc-8547-7ed91cf91c17 req-14c61d71-3591-4824-b2e5-b21c6b3dc3b7 tempest-TestShelveInstance-1471180316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0735e61e-632c-4956-a614-cb35a05b312d', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:23:46 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39" returned: 0 in 0.621s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39 Sep 28 18:23:46 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-93b6b4c4-623f-40fc-8547-7ed91cf91c17 req-14c61d71-3591-4824-b2e5-b21c6b3dc3b7 tempest-TestShelveInstance-1471180316 None] attachment_update completed successfully. Sep 28 18:23:46 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1.2cb13374-afed-4345-966a-2c0fd11b5a39" returned: 0 in 0.542s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-2cb13374-afed-4345-966a-2c0fd11b5a39" released by "_delete_snapshot" :: held 2.933s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" released by "delete_snapshot" :: held 2.976s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Created reservations ['a5579e5c-1dc5-4cb5-b687-4d79b6a8f208', '66141e19-553e-4b30-856f-203aba686039', '50dd188e-4573-4d3f-842c-2ef9fca56aa7', '250a1b43-1ad6-4387-9d39-14f0551d0827'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:46 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Delete snapshot completed successfully. Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-2cb13374-afed-4345-966a-2c0fd11b5a39-delete_snapshot" released by "delete_snapshot" :: held 3.265s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Snapshots deleted, issuing volume delete {{(pid=86981) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:23:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" acquired by "delete_volume" :: waited 0.053s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e6b62-6906-4b99-a6d8-b9b3292d73e8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 Sep 28 18:23:47 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" returned: 0 in 0.586s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1 Sep 28 18:23:47 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:48 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" returned: 0 in 0.385s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1" released by "delete_volume" :: held 1.118s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Created reservations ['b1a41f62-65bd-4fd3-aee2-03bdaed6e8db', 'da206505-264f-4c97-a4b7-dbf52001bf33', '54cc6bd2-0318-40bc-a88a-0aeb8671e252', '28efc049-e4b8-438b-837c-03fc23215123'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:23:48 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:48 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.482s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Deleted volume successfully. Sep 28 18:23:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a825fa8c-02b8-4246-9de8-005c889a0a58 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-02fa6be9-c7ae-408c-a9f8-bbfa70d06cf1-delete_volume" released by "delete_volume" :: held 5.398s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-277cf9bf-c498-4e94-b3db-bac630fc992e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-277cf9bf-c498-4e94-b3db-bac630fc992e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "cinder-quobyte-277cf9bf-c498-4e94-b3db-bac630fc992e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-277cf9bf-c498-4e94-b3db-bac630fc992e" acquired by "delete_volume" :: waited 0.043s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d11d50c-aac7-49a3-a161-a792b3d6b353]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:50 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e Sep 28 18:23:50 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e" returned: 0 in 0.810s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:50 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e Sep 28 18:23:50 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-277cf9bf-c498-4e94-b3db-bac630fc992e" returned: 0 in 0.846s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-quobyte-277cf9bf-c498-4e94-b3db-bac630fc992e" released by "delete_volume" :: held 1.753s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Created reservations ['86669d01-4302-4bbe-8f1a-2f8a3489d464', '6ae9696a-10cf-41c5-a796-6bb8f20bfaaa', '2c6040f0-bd64-45b7-af4f-8acd4d7f8e5a', '6e20c5e8-1d3b-428c-b0b3-10d564cd2c98'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:23:52 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:52 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.821s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:52 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Deleted volume successfully. Sep 28 18:23:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-06c93fc5-eaa1-44dd-abef-f4bff577df21 tempest-VolumesDeleteCascade-1644610092 None] Lock "cinder-277cf9bf-c498-4e94-b3db-bac630fc992e-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:59 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Flow 'volume_create_manager' (707b8458-e98d-489d-95eb-025dfe55b254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed37793e-0021-40ea-9063-b8655887ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed37793e-0021-40ea-9063-b8655887ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1014829573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3392c3-c802-4dac-a7fd-b6564a5105a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88538de6924b4d348c013cb42b399519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:00Z,use_quota=True,user_id='5fb61193fb7b424faec952eeb32bd0b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698a6db3-5f97-4022-9369-95a412f85c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698a6db3-5f97-4022-9369-95a412f85c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3d02cf-1e0a-4244-b846-d39b2d9b5078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3d02cf-1e0a-4244-b846-d39b2d9b5078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3392c3-c802-4dac-a7fd-b6564a5105a3', 'volume_name': 'volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f2ce58-6ce1-4ec1-bb2f-00071cd0d051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f2ce58-6ce1-4ec1-bb2f-00071cd0d051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1711fc-8c66-47d2-91fe-e664b2f0b914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Volume ec3392c3-c802-4dac-a7fd-b6564a5105a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3', 'volume_size': 1} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1014829573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3392c3-c802-4dac-a7fd-b6564a5105a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88538de6924b4d348c013cb42b399519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:00Z,use_quota=True,user_id='5fb61193fb7b424faec952eeb32bd0b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Creating volume ec3392c3-c802-4dac-a7fd-b6564a5105a3 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:00 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 1073741824 Sep 28 18:24:00 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:00 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 1073741824" returned: 0 in 0.488s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 Sep 28 18:24:00 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:00 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3" returned: 0 in 0.289s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1711fc-8c66-47d2-91fe-e664b2f0b914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8414ba8-e9ee-4f66-8b84-97d3b4c4c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Volume volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 (ec3392c3-c802-4dac-a7fd-b6564a5105a3): created successfully Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8414ba8-e9ee-4f66-8b84-97d3b4c4c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Flow 'volume_create_manager' (707b8458-e98d-489d-95eb-025dfe55b254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-56ec8983-6ccb-4a0b-aadb-69d6416ab399 tempest-VolumesTransfersV357Test-1462925604 None] Created volume successfully. Sep 28 18:24:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f3af1ec7-d895-49ab-8cd5-df300a478cb8 tempest-VolumesTransfersV357Test-154312705 None] Transfer volume completed successfully. Sep 28 18:24:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Acquiring lock "cinder-ec3392c3-c802-4dac-a7fd-b6564a5105a3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-ec3392c3-c802-4dac-a7fd-b6564a5105a3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Acquiring lock "cinder-quobyte-ec3392c3-c802-4dac-a7fd-b6564a5105a3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-quobyte-ec3392c3-c802-4dac-a7fd-b6564a5105a3" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:03 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b262273-c48c-4c7c-9e70-47006bc29787]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 Sep 28 18:24:04 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3" returned: 0 in 0.475s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3 Sep 28 18:24:04 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ec3392c3-c802-4dac-a7fd-b6564a5105a3" returned: 0 in 0.273s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-quobyte-ec3392c3-c802-4dac-a7fd-b6564a5105a3" released by "delete_volume" :: held 0.822s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Created reservations ['9e5b396f-40cc-4a8d-891b-a14c3c1010ec', '39de8d27-98dc-425e-b604-78c46b5d94fe', '65cf832f-888c-4305-8d5a-584025419f7d', '1d175c02-36a8-4d5c-bd0f-1909e59d78df'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:04 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:05 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.423s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:05 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Deleted volume successfully. Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0b4480ff-5b44-4519-b0ba-106bdc9c48dc tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-ec3392c3-c802-4dac-a7fd-b6564a5105a3-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Flow 'volume_create_manager' (f0d21f60-382d-4e57-9bf1-fc7538bcb86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea5c0de-ea7f-4034-b6d5-6a7db5c39967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea5c0de-ea7f-4034-b6d5-6a7db5c39967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-465247845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5492247f-dbe2-452f-8a45-9fa118e6b08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88538de6924b4d348c013cb42b399519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:06Z,use_quota=True,user_id='5fb61193fb7b424faec952eeb32bd0b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0259b0-1f67-4d73-a88e-2adb37c0a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0259b0-1f67-4d73-a88e-2adb37c0a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6506eade-bc84-4c67-95bb-690694554d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6506eade-bc84-4c67-95bb-690694554d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5492247f-dbe2-452f-8a45-9fa118e6b08e', 'volume_name': 'volume-5492247f-dbe2-452f-8a45-9fa118e6b08e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9714ac9-5963-48dc-b0d0-fedfd17e1466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9714ac9-5963-48dc-b0d0-fedfd17e1466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89027b12-1683-473c-a099-9bd0a6aa7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:05 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Volume 5492247f-dbe2-452f-8a45-9fa118e6b08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5492247f-dbe2-452f-8a45-9fa118e6b08e', 'volume_size': 1} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-465247845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5492247f-dbe2-452f-8a45-9fa118e6b08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88538de6924b4d348c013cb42b399519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:06Z,use_quota=True,user_id='5fb61193fb7b424faec952eeb32bd0b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Creating volume 5492247f-dbe2-452f-8a45-9fa118e6b08e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:05 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:24:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:05 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e 1073741824 Sep 28 18:24:05 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e 1073741824" returned: 0 in 0.488s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e Sep 28 18:24:06 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e" returned: 0 in 0.298s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89027b12-1683-473c-a099-9bd0a6aa7870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5492247f-dbe2-452f-8a45-9fa118e6b08e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9011bd0d-55b0-4c40-bd06-12a847d11677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:06 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Volume volume-5492247f-dbe2-452f-8a45-9fa118e6b08e (5492247f-dbe2-452f-8a45-9fa118e6b08e): created successfully Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9011bd0d-55b0-4c40-bd06-12a847d11677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Flow 'volume_create_manager' (f0d21f60-382d-4e57-9bf1-fc7538bcb86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:06 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-cc15bf96-3445-4486-be35-b06b79e669c9 tempest-VolumesTransfersV357Test-1462925604 None] Created volume successfully. Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Acquiring lock "cinder-5492247f-dbe2-452f-8a45-9fa118e6b08e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-5492247f-dbe2-452f-8a45-9fa118e6b08e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Acquiring lock "cinder-quobyte-5492247f-dbe2-452f-8a45-9fa118e6b08e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-quobyte-5492247f-dbe2-452f-8a45-9fa118e6b08e" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8ecec2-d1a1-4759-853e-c83c3f65bc9b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e Sep 28 18:24:08 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e" returned: 0 in 0.370s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e Sep 28 18:24:08 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5492247f-dbe2-452f-8a45-9fa118e6b08e" returned: 0 in 0.290s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-quobyte-5492247f-dbe2-452f-8a45-9fa118e6b08e" released by "delete_volume" :: held 0.705s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:08 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Created reservations ['18466ec0-e841-4514-9187-04d8b6131c31', 'd5c6a0ab-0450-4bfd-864a-2664633c5294', '73f50a54-0855-472c-824b-3277f952b07b', 'bc520d6d-bf80-416b-b67b-3f9e5c6e40b2'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:09 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.298s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Deleted volume successfully. Sep 28 18:24:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c4b6e37b-8183-4c65-b08c-cc051189f060 tempest-VolumesTransfersV357Test-489399484 None] Lock "cinder-5492247f-dbe2-452f-8a45-9fa118e6b08e-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-f1401d03-21b8-4f39-95d7-12d24166f308 req-c16f2c2f-e4d7-455c-82e7-458f67d7e523 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-f1401d03-21b8-4f39-95d7-12d24166f308 req-c16f2c2f-e4d7-455c-82e7-458f67d7e523 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-f1401d03-21b8-4f39-95d7-12d24166f308 req-c16f2c2f-e4d7-455c-82e7-458f67d7e523 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-f1401d03-21b8-4f39-95d7-12d24166f308 req-c16f2c2f-e4d7-455c-82e7-458f67d7e523 tempest-TestInstancesWithCinderVolumes-175962132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-e10de1a5-ad34-47ce-b581-36e23beef2c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64536a2c-88fb-4d62-9f6f-190a2e55ff3d', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:24:12 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-f1401d03-21b8-4f39-95d7-12d24166f308 req-c16f2c2f-e4d7-455c-82e7-458f67d7e523 tempest-TestInstancesWithCinderVolumes-175962132 None] attachment_update completed successfully. Sep 28 18:24:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-1ccf1026-6515-412f-a2e7-b0732a527926 req-5abbe4c0-aade-49a8-ae88-d30923052793 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-1ccf1026-6515-412f-a2e7-b0732a527926 req-5abbe4c0-aade-49a8-ae88-d30923052793 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-1ccf1026-6515-412f-a2e7-b0732a527926 req-5abbe4c0-aade-49a8-ae88-d30923052793 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-1ccf1026-6515-412f-a2e7-b0732a527926 req-5abbe4c0-aade-49a8-ae88-d30923052793 tempest-TestInstancesWithCinderVolumes-175962132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-405aa97c-e101-49b1-8850-31fe4391bef2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09b373aa-e40a-4f2c-a9d2-a32b44365829', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:24:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-1ccf1026-6515-412f-a2e7-b0732a527926 req-5abbe4c0-aade-49a8-ae88-d30923052793 tempest-TestInstancesWithCinderVolumes-175962132 None] attachment_update completed successfully. Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Flow 'volume_create_manager' (77e0f3bf-6fb0-43c7-9ff1-da85dccc38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fe9778-1988-4ffe-9088-160c0169999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fe9778-1988-4ffe-9088-160c0169999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-417822460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794271a9-e5a4-463d-8274-93fc1bb4c29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c46632395a4ada83431efed15a1cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:18Z,use_quota=True,user_id='0d76537b5d6247beb29f05b2e9b2c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0c88e9-9748-401b-9f85-0402a8e95e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0c88e9-9748-401b-9f85-0402a8e95e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d617e25-33b5-492b-939e-b4775593ebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d617e25-33b5-492b-939e-b4775593ebd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '794271a9-e5a4-463d-8274-93fc1bb4c29a', 'volume_name': 'volume-794271a9-e5a4-463d-8274-93fc1bb4c29a', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afba5197-f60b-47c5-9989-872e57602c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afba5197-f60b-47c5-9989-872e57602c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18925b29-1984-4d14-a926-b57c50c0f6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:18 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Volume 794271a9-e5a4-463d-8274-93fc1bb4c29a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-794271a9-e5a4-463d-8274-93fc1bb4c29a', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Trying to clone 794271a9-e5a4-463d-8274-93fc1bb4c29a from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:24:18 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1422e3-bbdb-44ac-9946-713321a22301]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:18 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD Sep 28 18:24:18 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:19 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 is fetched for user 0d76537b5d6247beb29f05b2e9b2c8c8. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d087d8-8d67-4607-aff7-b09767c138f0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:19 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD Sep 28 18:24:19 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:19 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD" returned: 0 in 0.535s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-417822460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794271a9-e5a4-463d-8274-93fc1bb4c29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c46632395a4ada83431efed15a1cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:18Z,use_quota=True,user_id='0d76537b5d6247beb29f05b2e9b2c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Creating volume 794271a9-e5a4-463d-8274-93fc1bb4c29a {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:19 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:24:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:19 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 1073741824 Sep 28 18:24:19 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:20 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 1073741824" returned: 0 in 0.576s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:20 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a Sep 28 18:24:20 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:20 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a" returned: 0 in 0.266s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Attempting download of 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume 794271a9-e5a4-463d-8274-93fc1bb4c29a. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd311d-fea4-470f-960c-3652ca6c48f2]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_6bdszqkd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:21 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_6bdszqkd Sep 28 18:24:21 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:21 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_6bdszqkd" returned: 0 in 0.350s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_6bdszqkd {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:21 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_6bdszqkd Sep 28 18:24:21 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:21 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_6bdszqkd" returned: 1 in 0.338s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_6bdszqkd' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ee8c7-45ef-4364-ac20-ec28840149d8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:21 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD Sep 28 18:24:21 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:22 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:22 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] 052187e4-f9b0-4ab2-bf54-351fdb1df836 was qcow2, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:24:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:22 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a Sep 28 18:24:22 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-ebb9b644-8c9a-4cd2-8c4e-542e43b45893 req-3e39d666-3f62-4fb4-858b-2bcdf170fd95 tempest-TestInstancesWithCinderVolumes-175962132 None] Terminate volume connection completed successfully. Sep 28 18:24:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-ebb9b644-8c9a-4cd2-8c4e-542e43b45893 req-3e39d666-3f62-4fb4-858b-2bcdf170fd95 tempest-TestInstancesWithCinderVolumes-175962132 None] Deleting attachment 64536a2c-88fb-4d62-9f6f-190a2e55ff3d. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "cinder-e10de1a5-ad34-47ce-b581-36e23beef2c7-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-e10de1a5-ad34-47ce-b581-36e23beef2c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "cinder-quobyte-e10de1a5-ad34-47ce-b581-36e23beef2c7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-quobyte-e10de1a5-ad34-47ce-b581-36e23beef2c7" acquired by "delete_volume" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca90612e-b5e1-4721-bc99-f0a4ca1efe6f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 Sep 28 18:24:23 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7" returned: 0 in 0.440s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7 Sep 28 18:24:23 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e10de1a5-ad34-47ce-b581-36e23beef2c7" returned: 0 in 0.282s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a" returned: 0 in 2.129s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_2w84vxh6devstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:24:24 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Converted 112.00 MB image at 52.56 MB/s Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-quobyte-e10de1a5-ad34-47ce-b581-36e23beef2c7" released by "delete_volume" :: held 0.804s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:24 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 1G Sep 28 18:24:24 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack cinder-volume[86981]: WARNING cinder.quota [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072674109-533850720 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072674109-533850720, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:24:24 devstack cinder-volume[86981]: WARNING cinder.quota [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072674109-533850720 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072674109-533850720, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Created reservations ['e34cf261-bf91-4d23-99a2-a67f6829948b', '9a2b69e5-ef63-4f68-ad12-8d96056b7bd3', '04af25e8-df65-4167-ac36-7351f0173b79', '5c7ce263-38a2-485e-8017-4ea23a94255f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:24 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 1G" returned: 0 in 0.516s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Downloaded image 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume 794271a9-e5a4-463d-8274-93fc1bb4c29a successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 for user 0d76537b5d6247beb29f05b2e9b2c8c8 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Marking volume 794271a9-e5a4-463d-8274-93fc1bb4c29a as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:24:24 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.325s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:24 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Deleted volume successfully. Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Copying metadata from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 to 794271a9-e5a4-463d-8274-93fc1bb4c29a. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Creating volume glance metadata for volume 794271a9-e5a4-463d-8274-93fc1bb4c29a backed by image 052187e4-f9b0-4ab2-bf54-351fdb1df836 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed7402cc-fda6-4e04-ab0d-25b72be90a6e tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-e10de1a5-ad34-47ce-b581-36e23beef2c7-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18925b29-1984-4d14-a926-b57c50c0f6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794271a9-e5a4-463d-8274-93fc1bb4c29a', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22653227-3527-4edc-a9f9-30a63ef0749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:24 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Volume volume-794271a9-e5a4-463d-8274-93fc1bb4c29a (794271a9-e5a4-463d-8274-93fc1bb4c29a): created successfully Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22653227-3527-4edc-a9f9-30a63ef0749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Flow 'volume_create_manager' (77e0f3bf-6fb0-43c7-9ff1-da85dccc38b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:24 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-041c209e-6a39-4575-af75-46ad3fb5e520 tempest-VolumesExtendTest-41173172 None] Created volume successfully. Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c187a4b2-1de4-4271-967d-0029adc7bb32]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a Sep 28 18:24:25 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a" returned: 0 in 0.438s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 2G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a 2G" returned: 0 in 0.108s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.570s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f1377d23-eb21-4594-b2d8-a059ed8a40eb tempest-VolumesExtendTest-41173172 None] Extend volume completed successfully. Sep 28 18:24:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Acquiring lock "cinder-794271a9-e5a4-463d-8274-93fc1bb4c29a-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Lock "cinder-794271a9-e5a4-463d-8274-93fc1bb4c29a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Acquiring lock "cinder-quobyte-794271a9-e5a4-463d-8274-93fc1bb4c29a" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-794271a9-e5a4-463d-8274-93fc1bb4c29a" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:26 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e89c9e-d17d-45cf-a480-35ca42dd8e08]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:27 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a Sep 28 18:24:27 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:27 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a" returned: 0 in 0.478s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:27 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a Sep 28 18:24:27 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:27 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-794271a9-e5a4-463d-8274-93fc1bb4c29a" returned: 0 in 0.265s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-794271a9-e5a4-463d-8274-93fc1bb4c29a" released by "delete_volume" :: held 0.813s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Created reservations ['5cf1461a-733a-4c8c-86f2-ef850339866d', 'd7fa204d-067f-45eb-819b-d9aee97d7669', '547ebd4d-11d4-48d8-bd75-1980a0f474ac', '63e50c23-11a3-44ef-9eb0-bddb0b716b02'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:27 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:27 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-345f0aac-4401-4a7f-8b43-baa6a469b885 req-f802f30e-c5de-4aed-af29-88da4201223a tempest-TestInstancesWithCinderVolumes-175962132 None] Terminate volume connection completed successfully. Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-345f0aac-4401-4a7f-8b43-baa6a469b885 req-f802f30e-c5de-4aed-af29-88da4201223a tempest-TestInstancesWithCinderVolumes-175962132 None] Deleting attachment 09b373aa-e40a-4f2c-a9d2-a32b44365829. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:24:28 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Deleted volume successfully. Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-de114a09-65e4-49f2-b0d2-287fe881668b tempest-VolumesExtendTest-41173172 None] Lock "cinder-794271a9-e5a4-463d-8274-93fc1bb4c29a-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "cinder-405aa97c-e101-49b1-8850-31fe4391bef2-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-405aa97c-e101-49b1-8850-31fe4391bef2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Flow 'volume_create_manager' (0a45444e-74b3-4e31-bd7f-b44d744fe040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b87be48-8cb7-494c-b7b7-aafb67cbb31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "cinder-quobyte-405aa97c-e101-49b1-8850-31fe4391bef2" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b87be48-8cb7-494c-b7b7-aafb67cbb31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1594777499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bac2722-4052-46e3-9dd8-261d779604d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c46632395a4ada83431efed15a1cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:29Z,use_quota=True,user_id='0d76537b5d6247beb29f05b2e9b2c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad17eeb8-9b4b-43f8-82f0-a7b383d757d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad17eeb8-9b4b-43f8-82f0-a7b383d757d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545efe90-7ee1-4a90-9517-1585e711923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545efe90-7ee1-4a90-9517-1585e711923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bac2722-4052-46e3-9dd8-261d779604d4', 'volume_name': 'volume-4bac2722-4052-46e3-9dd8-261d779604d4', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7b81c2-5f4b-43f0-a732-cb4d21dd38da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7b81c2-5f4b-43f0-a732-cb4d21dd38da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e3c18f-9edd-4e2e-8ec5-23a07cee11fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Volume 4bac2722-4052-46e3-9dd8-261d779604d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bac2722-4052-46e3-9dd8-261d779604d4', 'volume_size': 1} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1594777499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bac2722-4052-46e3-9dd8-261d779604d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c46632395a4ada83431efed15a1cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:29Z,use_quota=True,user_id='0d76537b5d6247beb29f05b2e9b2c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Creating volume 4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:28 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-quobyte-405aa97c-e101-49b1-8850-31fe4391bef2" acquired by "delete_volume" :: waited 0.112s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:28 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 1073741824 Sep 28 18:24:28 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba07271-1eca-4c99-8c1b-cf33e9bae31c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 Sep 28 18:24:29 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2" returned: 0 in 0.463s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2 Sep 28 18:24:29 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 1073741824" returned: 0 in 0.598s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 Sep 28 18:24:29 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-405aa97c-e101-49b1-8850-31fe4391bef2" returned: 0 in 0.291s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-quobyte-405aa97c-e101-49b1-8850-31fe4391bef2" released by "delete_volume" :: held 0.826s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:29 devstack cinder-volume[86981]: WARNING cinder.quota [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311473032-1381370413 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311473032-1381370413, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:24:29 devstack cinder-volume[86981]: WARNING cinder.quota [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311473032-1381370413 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-311473032-1381370413, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Created reservations ['1f24c77c-b7c5-47f3-a61c-05b4900b39e3', 'fd8c7caa-3fa8-4e7a-8a87-885d7f4ca58e', '9730a6ca-7c24-4976-9d2f-4c27b5f80f4b', '6ee1f902-06ac-4ed3-a5e2-9c482aea3452'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:29 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4" returned: 0 in 0.343s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e3c18f-9edd-4e2e-8ec5-23a07cee11fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bac2722-4052-46e3-9dd8-261d779604d4', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21aeb3b-4199-4982-9276-7a916782b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:29 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:29 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Volume volume-4bac2722-4052-46e3-9dd8-261d779604d4 (4bac2722-4052-46e3-9dd8-261d779604d4): created successfully Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21aeb3b-4199-4982-9276-7a916782b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Flow 'volume_create_manager' (0a45444e-74b3-4e31-bd7f-b44d744fe040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:29 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4244ba5c-b4b9-4494-aa79-c9d2d4a2314c tempest-VolumesExtendTest-41173172 None] Created volume successfully. Sep 28 18:24:30 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.347s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Deleted volume successfully. Sep 28 18:24:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26fe7426-82ec-4afc-9789-85aa8e727b34 tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-405aa97c-e101-49b1-8850-31fe4391bef2-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Creating offline snapshot cc189256-e17f-424f-b233-8a6cda2275f8 of volume 4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:31 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e49f7-987c-450b-8a2b-d45f393a6e7c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 Sep 28 18:24:31 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4" returned: 0 in 0.549s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 1G Sep 28 18:24:31 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:32 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 1G" returned: 0 in 0.603s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bac2722-4052-46e3-9dd8-261d779604d4 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:32 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bac2722-4052-46e3-9dd8-261d779604d4 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 Sep 28 18:24:32 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:32 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bac2722-4052-46e3-9dd8-261d779604d4 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8" returned: 0 in 0.419s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 is being set with open permissions: ugo+rw Sep 28 18:24:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:32 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 Sep 28 18:24:32 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:32 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8" returned: 0 in 0.312s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:33 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.info Sep 28 18:24:33 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:33 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.info" returned: 0 in 0.442s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:33 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.info is being set with open permissions: ugo+rw Sep 28 18:24:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:33 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.info Sep 28 18:24:33 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:33 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.info" returned: 0 in 0.311s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-122ae6ce-9909-4dca-91bd-9f5acc1bfbe2 tempest-VolumesExtendTest-41173172 None] Create snapshot completed successfully Sep 28 18:24:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e144f74-6fe9-424a-b385-4a22a05e8698]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:34 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 Sep 28 18:24:34 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:35 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4" returned: 0 in 0.642s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 2G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-b6bb7e9e-269b-42ef-b045-e6ef7d1d5862 req-959a38bf-4c2a-42ce-b528-3e1e5aa18a50 tempest-TestInstancesWithCinderVolumes-175962132 None] Terminate volume connection completed successfully. Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-b6bb7e9e-269b-42ef-b045-e6ef7d1d5862 req-959a38bf-4c2a-42ce-b528-3e1e5aa18a50 tempest-TestInstancesWithCinderVolumes-175962132 None] Deleting attachment 44904b4e-f5df-4228-be77-75927941af99. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 2G" returned: 0 in 0.242s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.942s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-496f0ad4-0aad-480d-8dc0-1ea455e52b71 tempest-VolumesExtendTest-41173172 None] Extend volume completed successfully. Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Acquiring lock "cinder-cc189256-e17f-424f-b233-8a6cda2275f8-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Lock "cinder-cc189256-e17f-424f-b233-8a6cda2275f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Acquiring lock "cinder-quobyte-4bac2722-4052-46e3-9dd8-261d779604d4" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-4bac2722-4052-46e3-9dd8-261d779604d4" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Acquiring lock "cinder-quobyte-cc189256-e17f-424f-b233-8a6cda2275f8" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-cc189256-e17f-424f-b233-8a6cda2275f8" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Deleting offline snapshot cc189256-e17f-424f-b233-8a6cda2275f8 of volume 4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] snapshot_file for this snap is: volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b564919-9415-4ee9-a6ca-5466101b1647]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:36 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 Sep 28 18:24:36 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:36 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8" returned: 0 in 0.639s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bac2722-4052-46e3-9dd8-261d779604d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b85dfd9-8560-4d3a-aa3e-fd9462cf97c3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:36 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 Sep 28 18:24:36 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "cinder-2e506e90-cf67-4e52-9d94-221ec0562054-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:37 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4" returned: 0 in 0.638s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-2e506e90-cf67-4e52-9d94-221ec0562054-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:37 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 Sep 28 18:24:37 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "cinder-quobyte-2e506e90-cf67-4e52-9d94-221ec0562054" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-quobyte-2e506e90-cf67-4e52-9d94-221ec0562054" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[128beb37-a7fb-477c-ae1e-015a5104f84d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-7496187e-15da-404a-8ab6-4f59cfa72232 tempest-TestShelveInstance-1471180316 None] Terminate volume connection completed successfully. Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-7496187e-15da-404a-8ab6-4f59cfa72232 tempest-TestShelveInstance-1471180316 None] Deleting attachment 0735e61e-632c-4956-a614-cb35a05b312d. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:24:37 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 Sep 28 18:24:37 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Acquiring lock "cinder-50b2b911-ea3d-41b3-8b5e-a311c9f5016b-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Lock "cinder-50b2b911-ea3d-41b3-8b5e-a311c9f5016b-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=83,cinder:UPDATE=98,cinder:DELETE=8,cinder:INSERT=22 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Acquiring lock "cinder-quobyte-50b2b911-ea3d-41b3-8b5e-a311c9f5016b" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Lock "cinder-quobyte-50b2b911-ea3d-41b3-8b5e-a311c9f5016b" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:38 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8" returned: 0 in 0.767s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054" returned: 0 in 0.584s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5295a7b-d09b-4288-bc06-daeadaf7185b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:38 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8 Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054 Sep 28 18:24:38 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b Sep 28 18:24:38 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2e506e90-cf67-4e52-9d94-221ec0562054" returned: 0 in 0.347s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-quobyte-2e506e90-cf67-4e52-9d94-221ec0562054" released by "delete_volume" :: held 1.010s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:38 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4.cc189256-e17f-424f-b233-8a6cda2275f8" returned: 0 in 0.419s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=101,cinder:INSERT=29,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-cc189256-e17f-424f-b233-8a6cda2275f8" released by "_delete_snapshot" :: held 2.689s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:38 devstack cinder-volume[86981]: WARNING cinder.quota [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-403507060-300781694 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-403507060-300781694, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:24:38 devstack cinder-volume[86981]: WARNING cinder.quota [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-403507060-300781694 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-403507060-300781694, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-4bac2722-4052-46e3-9dd8-261d779604d4" released by "delete_snapshot" :: held 2.748s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Created reservations ['ed23ca3f-0003-4355-8a8d-ffbfebbcbde6', '38293444-dc00-4d66-ada0-d062605e4168', '72ea6687-f0ac-4275-8e78-bca3118e3f50', '6793a9cb-68d4-4bfa-a9b8-62303a592e79'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:38 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b" returned: 0 in 0.566s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b Sep 28 18:24:38 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Created reservations ['0fee17a3-daef-434c-8033-3abab8d8067a', '3c6ae1fd-ea8b-4484-b589-43439e9b0524', '02b32277-84d8-4bbe-9d2f-02276891a9cb', 'b7d0195e-c549-4aae-923c-90acfd1af925'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:38 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:38 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:38 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Delete snapshot completed successfully. Sep 28 18:24:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8d0161e9-05b6-4611-a5d7-e6057baf4b22 tempest-VolumesExtendTest-41173172 None] Lock "cinder-cc189256-e17f-424f-b233-8a6cda2275f8-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:39 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.337s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:39 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-50b2b911-ea3d-41b3-8b5e-a311c9f5016b" returned: 0 in 0.385s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Lock "cinder-quobyte-50b2b911-ea3d-41b3-8b5e-a311c9f5016b" released by "delete_volume" :: held 1.053s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:39 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:39 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Deleted volume successfully. Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.quota [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Created reservations ['56a02998-5c34-4031-bf91-0f57f0075991', '916be064-4436-41c0-b62d-1b5246e9b214', 'cd20834f-7a70-4fa2-ab73-ada34612cffc', '9eae8906-f65d-4bc2-8666-3b5f1302240c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Acquiring lock "cinder-4bac2722-4052-46e3-9dd8-261d779604d4-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-29872341-cbc9-42cf-95a5-fb39c2937fcc tempest-TestInstancesWithCinderVolumes-175962132 None] Lock "cinder-2e506e90-cf67-4e52-9d94-221ec0562054-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Lock "cinder-4bac2722-4052-46e3-9dd8-261d779604d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Acquiring lock "cinder-quobyte-4bac2722-4052-46e3-9dd8-261d779604d4" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-4bac2722-4052-46e3-9dd8-261d779604d4" acquired by "delete_volume" :: waited 0.051s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:39 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:39 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9129c015-1bf6-4bf2-bc27-edcfa2b88c16]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:39 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 Sep 28 18:24:39 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:39 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.316s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.manager [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:39 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Deleted volume successfully. Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [req-1b9277e9-83cc-44a3-a17f-6567d8bc160e req-5b352c63-965e-456c-bf1f-b8eb3f6d7fda tempest-TestShelveInstance-1471180316 None] Lock "cinder-50b2b911-ea3d-41b3-8b5e-a311c9f5016b-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:39 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4" returned: 0 in 0.475s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:40 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4 Sep 28 18:24:40 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:40 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4bac2722-4052-46e3-9dd8-261d779604d4" returned: 0 in 0.344s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Lock "cinder-quobyte-4bac2722-4052-46e3-9dd8-261d779604d4" released by "delete_volume" :: held 0.923s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Created reservations ['438850ee-5ddf-47ec-8e52-8d8b6195bb08', '19eaa73b-26c7-4c96-bb2c-8d3744ecfc8d', 'be421367-0e9a-45b5-b8df-90b6b9b9eafc', '9a7a279e-1a7c-4ee3-bb73-95ed7820e85f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:40 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:40 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:40 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.330s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Deleted volume successfully. Sep 28 18:24:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c39982f-a20d-41a6-97db-51399bca22f3 tempest-VolumesExtendTest-41173172 None] Lock "cinder-4bac2722-4052-46e3-9dd8-261d779604d4-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (37ecbd80-eb56-410e-be6f-f8777b73cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcea2e9-7bc7-4ef8-a851-0f7c76de8146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcea2e9-7bc7-4ef8-a851-0f7c76de8146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-147191988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e6fbf6-bec7-46b1-b38a-2ae7a0a25602,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:48Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1266290b-e9e5-43f0-8574-a007c355ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1266290b-e9e5-43f0-8574-a007c355ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548eaadd-e001-4b75-b555-e9e79c87c848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548eaadd-e001-4b75-b555-e9e79c87c848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e6fbf6-bec7-46b1-b38a-2ae7a0a25602', 'volume_name': 'volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab3cd07-40b2-4329-b8a4-849591cb2b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab3cd07-40b2-4329-b8a4-849591cb2b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d2d0c4-6715-47a8-8b9b-ab451cf4893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:48 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Volume 29e6fbf6-bec7-46b1-b38a-2ae7a0a25602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602', 'volume_size': 1} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-147191988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e6fbf6-bec7-46b1-b38a-2ae7a0a25602,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:48Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Creating volume 29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:48 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:48 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 1073741824 Sep 28 18:24:48 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:48 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 1073741824" returned: 0 in 0.572s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:48 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 Sep 28 18:24:48 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:49 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602" returned: 0 in 0.327s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d2d0c4-6715-47a8-8b9b-ab451cf4893c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caaf009-5358-4cc4-856f-05c9df59db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:49 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Volume volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 (29e6fbf6-bec7-46b1-b38a-2ae7a0a25602): created successfully Sep 28 18:24:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caaf009-5358-4cc4-856f-05c9df59db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (37ecbd80-eb56-410e-be6f-f8777b73cc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-da700149-07ac-44ab-a7c2-c1fe25be625d tempest-VolumesGetTest-977381580 None] Created volume successfully. Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (259621a0-85bb-43e3-8f03-dbbda7cf7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ee4b1a-6bf7-401b-8150-11c5d9e3fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ee4b1a-6bf7-401b-8150-11c5d9e3fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1726113937',display_name='tempest-VolumesGetTest-Volume-1555225560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:51Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f2bbb6-637a-4ec5-94eb-eb9fde5823d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f2bbb6-637a-4ec5-94eb-eb9fde5823d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79e067d-006f-40e7-b289-5a508a8a7d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79e067d-006f-40e7-b289-5a508a8a7d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac', 'volume_name': 'volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b17f0b-b0b3-4085-9e0b-45f8600aa75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b17f0b-b0b3-4085-9e0b-45f8600aa75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9431381e-4187-4f26-8971-01a542ae87c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:51 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Volume 7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac', 'volume_size': 1} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1726113937',display_name='tempest-VolumesGetTest-Volume-1555225560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:51Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Creating volume 7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:51 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:24:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:51 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac 1073741824 Sep 28 18:24:51 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac 1073741824" returned: 0 in 0.795s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:52 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac Sep 28 18:24:52 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac" returned: 0 in 0.318s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9431381e-4187-4f26-8971-01a542ae87c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7472913d-76d9-48b9-95c4-df487c04cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:52 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Volume volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac (7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac): created successfully Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7472913d-76d9-48b9-95c4-df487c04cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (259621a0-85bb-43e3-8f03-dbbda7cf7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5e4c9300-1977-42b4-a5ce-23df50bc25be tempest-VolumesGetTest-977381580 None] Created volume successfully. Sep 28 18:24:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Lock "cinder-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a614b6-650d-41ce-879a-5aad00d0453d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac Sep 28 18:24:53 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:54 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac" returned: 0 in 0.451s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:54 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac Sep 28 18:24:54 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:54 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac" returned: 0 in 0.276s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac" released by "delete_volume" :: held 0.809s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Created reservations ['24d98373-63fc-4c47-8d25-50df59aef64a', '4eabbaac-3643-47ae-a91d-63c60b13b7fe', '95e20956-42af-46e3-8244-c9ac1bd16b23', '757385ea-ee16-46c3-9828-3c5bfcadf416'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:54 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:54 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Lock "cinder-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:55 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.439s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Deleted volume successfully. Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602" acquired by "delete_volume" :: waited 0.049s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f35d0755-a8d0-46f8-8d53-508ffaca364b tempest-VolumesGetTest-977381580 None] Lock "cinder-7f4b9d5d-57cf-44e2-82b1-08ae6a0e2eac-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b612816c-1e17-4417-8765-85b8723b8dec]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:55 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 Sep 28 18:24:55 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602" returned: 0 in 0.454s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:55 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602 Sep 28 18:24:55 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602" returned: 0 in 0.278s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602" released by "delete_volume" :: held 0.802s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Created reservations ['17b59013-2e2c-4978-8d85-653094c440d0', '2811eb91-5038-48c5-ad5c-6d47f0bff5aa', '3442b98b-682a-4d4b-9c76-31bbe9e2b8fc', '2f00de12-141a-42e6-8f07-dcece1b74aab'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:56 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:24:56 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:56 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.333s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Deleted volume successfully. Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a6ce390e-bc86-4548-83a7-9835326d6d9f tempest-VolumesGetTest-977381580 None] Lock "cinder-29e6fbf6-bec7-46b1-b38a-2ae7a0a25602-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (f34cda5a-8fa2-4c10-ad4b-648f91941d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b2ca5e-e81a-4e51-85ea-b2e08e912e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b2ca5e-e81a-4e51-85ea-b2e08e912e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-918110536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd68178-0d9f-4022-bacb-573d0870c04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:57Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24930ddd-3e20-4cd0-a3fa-8e12591d7293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24930ddd-3e20-4cd0-a3fa-8e12591d7293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c8aadb-d8e5-4717-9efa-4a2693e0d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c8aadb-d8e5-4717-9efa-4a2693e0d95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd68178-0d9f-4022-bacb-573d0870c04c', 'volume_name': 'volume-8dd68178-0d9f-4022-bacb-573d0870c04c', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bdde95-719a-4dad-8a7a-ef5e4f238ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bdde95-719a-4dad-8a7a-ef5e4f238ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f752cd4e-2f4e-480e-8b2e-cb13866b0d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Volume 8dd68178-0d9f-4022-bacb-573d0870c04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd68178-0d9f-4022-bacb-573d0870c04c', 'volume_size': 1} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-918110536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd68178-0d9f-4022-bacb-573d0870c04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:57Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Creating volume 8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:57 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c 1073741824 Sep 28 18:24:57 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c 1073741824" returned: 0 in 0.648s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c Sep 28 18:24:57 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:58 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c" returned: 0 in 0.342s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f752cd4e-2f4e-480e-8b2e-cb13866b0d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd68178-0d9f-4022-bacb-573d0870c04c', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718d3501-5eda-44b7-a482-b579aecdf1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:58 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Volume volume-8dd68178-0d9f-4022-bacb-573d0870c04c (8dd68178-0d9f-4022-bacb-573d0870c04c): created successfully Sep 28 18:24:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718d3501-5eda-44b7-a482-b579aecdf1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (f34cda5a-8fa2-4c10-ad4b-648f91941d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3de52580-540e-4287-a7c2-70b2ec19eb94 tempest-VolumesGetTest-977381580 None] Created volume successfully. Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (f214492e-4819-452c-a1fd-6afbb23bc399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e448f48-dd48-478e-bc03-e6de10aa7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e448f48-dd48-478e-bc03-e6de10aa7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1693236166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9287d7e0-0bca-4e28-92cb-b5cce1870400,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8dd68178-0d9f-4022-bacb-573d0870c04c,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:00Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c023e5-fd6a-4b6a-bc3a-932ff79101a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c023e5-fd6a-4b6a-bc3a-932ff79101a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9023622f-7ad0-4cbc-81c8-5bf04c0534da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9023622f-7ad0-4cbc-81c8-5bf04c0534da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9287d7e0-0bca-4e28-92cb-b5cce1870400', 'volume_name': 'volume-9287d7e0-0bca-4e28-92cb-b5cce1870400', 'volume_size': 1, 'source_volid': '8dd68178-0d9f-4022-bacb-573d0870c04c', 'source_volstatus': 'available'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40ecaff-0ae8-40ee-a507-4c77d0dfbc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40ecaff-0ae8-40ee-a507-4c77d0dfbc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5683eb6-7a53-4f22-8cb6-1ae6b5cc991d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:59 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Volume 9287d7e0-0bca-4e28-92cb-b5cce1870400: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9287d7e0-0bca-4e28-92cb-b5cce1870400', 'volume_size': 1, 'source_volid': '8dd68178-0d9f-4022-bacb-573d0870c04c', 'source_volstatus': 'available'} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:59 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Cloning volume 8dd68178-0d9f-4022-bacb-573d0870c04c to volume 9287d7e0-0bca-4e28-92cb-b5cce1870400 Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Creating offline snapshot 49c22001-fbec-4e23-bfc0-3fa6d186c8cf of volume 8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92cf983-3c21-4863-b602-7f7af4516099]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c Sep 28 18:25:00 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c" returned: 0 in 0.453s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf 1G Sep 28 18:25:00 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf 1G" returned: 0 in 0.523s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd68178-0d9f-4022-bacb-573d0870c04c -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd68178-0d9f-4022-bacb-573d0870c04c -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf Sep 28 18:25:00 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd68178-0d9f-4022-bacb-573d0870c04c -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf" returned: 0 in 0.376s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf is being set with open permissions: ugo+rw Sep 28 18:25:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf Sep 28 18:25:01 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf" returned: 0 in 0.312s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.info Sep 28 18:25:01 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.info" returned: 0 in 0.273s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.info is being set with open permissions: ugo+rw Sep 28 18:25:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.info Sep 28 18:25:01 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:02 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.info" returned: 0 in 0.257s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-9287d7e0-0bca-4e28-92cb-b5cce1870400" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-9287d7e0-0bca-4e28-92cb-b5cce1870400" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] snapshot: 49c22001-fbec-4e23-bfc0-3fa6d186c8cf, volume: 9287d7e0-0bca-4e28-92cb-b5cce1870400, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1685809-abed-4fd0-8590-fcdee355beec]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:02 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf Sep 28 18:25:02 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:02 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf" returned: 0 in 0.522s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd68178-0d9f-4022-bacb-573d0870c04c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e031a5-65c0-4776-946b-b9779357af58]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:02 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c Sep 28 18:25:02 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:03 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c" returned: 0 in 0.412s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:25:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:25:03 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:25:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:03 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 Sep 28 18:25:03 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400" returned: 0 in 7.162s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:25:10 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Converted 1024.00 MB image at 142.94 MB/s Sep 28 18:25:10 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 is being set with open permissions: ugo+rw Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:10 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 Sep 28 18:25:10 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400" returned: 0 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-9287d7e0-0bca-4e28-92cb-b5cce1870400" released by "_copy_volume_from_snapshot" :: held 8.611s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-49c22001-fbec-4e23-bfc0-3fa6d186c8cf" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-49c22001-fbec-4e23-bfc0-3fa6d186c8cf" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Deleting offline snapshot 49c22001-fbec-4e23-bfc0-3fa6d186c8cf of volume 8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] snapshot_file for this snap is: volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1af248c-9f97-435c-94b3-e6eebab9f9d2]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:11 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf Sep 28 18:25:11 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:11 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf" returned: 0 in 0.453s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd68178-0d9f-4022-bacb-573d0870c04c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee05a48-3e35-4174-9b6e-a826ad9aba65]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:11 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c Sep 28 18:25:11 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:11 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=57,cinder:SELECT=33,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:12 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c" returned: 0 in 0.771s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf Sep 28 18:25:12 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf" returned: 0 in 0.397s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf Sep 28 18:25:12 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c.49c22001-fbec-4e23-bfc0-3fa6d186c8cf" returned: 0 in 0.267s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-49c22001-fbec-4e23-bfc0-3fa6d186c8cf" released by "_delete_snapshot" :: held 2.038s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.092s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5683eb6-7a53-4f22-8cb6-1ae6b5cc991d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9287d7e0-0bca-4e28-92cb-b5cce1870400', 'volume_size': 1, 'source_volid': '8dd68178-0d9f-4022-bacb-573d0870c04c', 'source_volstatus': 'available'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58b4b35-c3c8-472a-8b13-8e3e4ab73c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Volume volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 (9287d7e0-0bca-4e28-92cb-b5cce1870400): created successfully Sep 28 18:25:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58b4b35-c3c8-472a-8b13-8e3e4ab73c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (f214492e-4819-452c-a1fd-6afbb23bc399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f0e90508-eee4-491d-b271-547ea5fd6bcb tempest-VolumesGetTest-977381580 None] Created volume successfully. Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (6476720b-d0aa-4f2e-9089-0a0b1e1355e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9721922a-39a3-43eb-a461-42bfb7590c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9721922a-39a3-43eb-a461-42bfb7590c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-235325581',display_name='tempest-VolumesGetTest-Volume-568246513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be298081-fd5f-4f5b-90e7-2c6ff2b42673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:15Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d706d51-85f4-4fe4-9b95-239aaaaf14ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d706d51-85f4-4fe4-9b95-239aaaaf14ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d78f4-3e2c-459f-9161-d7caf45d4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d78f4-3e2c-459f-9161-d7caf45d4284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be298081-fd5f-4f5b-90e7-2c6ff2b42673', 'volume_name': 'volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922855f4-7dcf-4734-8032-53a39d877977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922855f4-7dcf-4734-8032-53a39d877977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc8b60-e7e7-4fae-98c6-54cc5aa8ec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:14 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Volume be298081-fd5f-4f5b-90e7-2c6ff2b42673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673', 'volume_size': 1} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-235325581',display_name='tempest-VolumesGetTest-Volume-568246513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be298081-fd5f-4f5b-90e7-2c6ff2b42673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:15Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Creating volume be298081-fd5f-4f5b-90e7-2c6ff2b42673 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:14 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:25:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:14 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 1073741824 Sep 28 18:25:14 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:15 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 1073741824" returned: 0 in 0.501s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:15 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 Sep 28 18:25:15 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:15 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673" returned: 0 in 0.335s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc8b60-e7e7-4fae-98c6-54cc5aa8ec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3da70e-41be-4164-ad64-cba31891bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:15 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Volume volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 (be298081-fd5f-4f5b-90e7-2c6ff2b42673): created successfully Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3da70e-41be-4164-ad64-cba31891bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (6476720b-d0aa-4f2e-9089-0a0b1e1355e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fc506ef0-96c4-464f-b426-f611e0466331 tempest-VolumesGetTest-977381580 None] Created volume successfully. Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-be298081-fd5f-4f5b-90e7-2c6ff2b42673-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Lock "cinder-be298081-fd5f-4f5b-90e7-2c6ff2b42673-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-be298081-fd5f-4f5b-90e7-2c6ff2b42673" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-be298081-fd5f-4f5b-90e7-2c6ff2b42673" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08881e0-d7ed-4383-a079-a976303168b2]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:17 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 Sep 28 18:25:17 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:17 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:17 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673 Sep 28 18:25:17 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:17 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-be298081-fd5f-4f5b-90e7-2c6ff2b42673" returned: 0 in 0.274s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-be298081-fd5f-4f5b-90e7-2c6ff2b42673" released by "delete_volume" :: held 0.799s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Created reservations ['534b3614-1d61-451c-a69a-471d4409ff88', '2935dfcb-a380-484d-8b1a-0df46391af3e', '20627b6c-2c5c-4e54-80fa-f7b970eff910', '28fe12de-d19d-4c60-9e6f-30dcb841e725'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:18 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-9287d7e0-0bca-4e28-92cb-b5cce1870400-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Lock "cinder-9287d7e0-0bca-4e28-92cb-b5cce1870400-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-9287d7e0-0bca-4e28-92cb-b5cce1870400" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-9287d7e0-0bca-4e28-92cb-b5cce1870400" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5688a3-2ac7-4696-8824-3c8eb3a2a66e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.533s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Deleted volume successfully. Sep 28 18:25:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7bd8ce6-38eb-49ac-a797-da0479756bc2 tempest-VolumesGetTest-977381580 None] Lock "cinder-be298081-fd5f-4f5b-90e7-2c6ff2b42673-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:18 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 Sep 28 18:25:18 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:19 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400" returned: 0 in 0.474s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:19 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400 Sep 28 18:25:19 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:19 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9287d7e0-0bca-4e28-92cb-b5cce1870400" returned: 0 in 0.332s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-9287d7e0-0bca-4e28-92cb-b5cce1870400" released by "delete_volume" :: held 0.867s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Created reservations ['6205c15a-aecc-4e06-9c01-3a44a33dbf64', '05b3a3d2-a49a-4987-b17b-db24e9172f9d', '3581b492-2948-42c6-b5f4-7aec7caad274', '96beb719-aecf-484f-942a-c5edaec8cdd6'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:19 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:19 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:19 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.279s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Deleted volume successfully. Sep 28 18:25:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a638797d-f7f9-485c-a2f0-81668e896243 tempest-VolumesGetTest-977381580 None] Lock "cinder-9287d7e0-0bca-4e28-92cb-b5cce1870400-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-8dd68178-0d9f-4022-bacb-573d0870c04c-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Lock "cinder-8dd68178-0d9f-4022-bacb-573d0870c04c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-8dd68178-0d9f-4022-bacb-573d0870c04c" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-8dd68178-0d9f-4022-bacb-573d0870c04c" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c9973c-7c22-4e89-87d6-036111683dd3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:21 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c Sep 28 18:25:21 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:21 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c" returned: 0 in 0.464s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:21 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c Sep 28 18:25:21 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:21 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8dd68178-0d9f-4022-bacb-573d0870c04c" returned: 0 in 0.296s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-8dd68178-0d9f-4022-bacb-573d0870c04c" released by "delete_volume" :: held 0.852s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Created reservations ['db0b15e6-ec3c-477f-8e74-24a11d86d4b1', 'dad5f1da-1955-46bc-9f3f-3d4133844928', 'c71c1c24-e5d5-45ce-8831-66d8073102aa', '6d5e1fc4-3b2a-4153-a377-293c5550e600'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:22 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:22 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:22 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.456s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:22 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Deleted volume successfully. Sep 28 18:25:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-87d3475d-70c0-467f-aea5-8839ca5d7209 tempest-VolumesGetTest-977381580 None] Lock "cinder-8dd68178-0d9f-4022-bacb-573d0870c04c-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (5a49671d-abaf-43fc-8c51-1a1ff0723142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e97049-da45-40cf-93bb-981407affdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e97049-da45-40cf-93bb-981407affdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1897415827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d4321f-436d-4480-b6cc-07c63c447cb7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:23Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabae1a9-10f0-4132-a9a6-6ce1b3a54095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabae1a9-10f0-4132-a9a6-6ce1b3a54095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a0de85-1e0a-4e7c-b140-3839e0e21059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a0de85-1e0a-4e7c-b140-3839e0e21059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3d4321f-436d-4480-b6cc-07c63c447cb7', 'volume_name': 'volume-e3d4321f-436d-4480-b6cc-07c63c447cb7', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cb4899-caa5-4c4b-a7fc-6eaf2fd6a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cb4899-caa5-4c4b-a7fc-6eaf2fd6a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5d959d-b73c-4431-9f85-b291147e1f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:23 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Volume e3d4321f-436d-4480-b6cc-07c63c447cb7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3d4321f-436d-4480-b6cc-07c63c447cb7', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:25:23 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Trying to clone e3d4321f-436d-4480-b6cc-07c63c447cb7 from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:25:24 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d663be24-2416-43be-9fd6-2002340c3254]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD Sep 28 18:25:24 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 is fetched for user 053df8ad5db04919baac626732e61022. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b585eb0e-46af-445d-adc2-33ff34276013]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD Sep 28 18:25:24 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1897415827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d4321f-436d-4480-b6cc-07c63c447cb7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:23Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Creating volume e3d4321f-436d-4480-b6cc-07c63c447cb7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:24 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:25:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 1073741824 Sep 28 18:25:25 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 1073741824" returned: 0 in 0.498s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 Sep 28 18:25:25 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7" returned: 0 in 0.244s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Attempting download of 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume e3d4321f-436d-4480-b6cc-07c63c447cb7. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[23780125-6930-47e1-b679-5d2383fe7aff]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_kjtn_dfe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_kjtn_dfe Sep 28 18:25:25 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:26 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_kjtn_dfe" returned: 0 in 0.366s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_kjtn_dfe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:26 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_kjtn_dfe Sep 28 18:25:26 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:26 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_kjtn_dfe" returned: 1 in 0.377s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_052187e4-f9b0-4ab2-bf54-351fdb1df836_kjtn_dfe' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a7bee-fdf5-414e-97b0-400738fd44ab]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:26 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD Sep 28 18:25:26 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:26 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:26 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] 052187e4-f9b0-4ab2-bf54-351fdb1df836 was qcow2, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:25:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:27 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 Sep 28 18:25:27 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:29 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7" returned: 0 in 2.486s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_052187e4-f9b0-4ab2-bf54-351fdb1df836_grn08fgzdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:25:29 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Converted 112.00 MB image at 45.03 MB/s Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:29 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 1G Sep 28 18:25:29 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:29 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 1G" returned: 0 in 0.359s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Downloaded image 052187e4-f9b0-4ab2-bf54-351fdb1df836 ((None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}])) to volume e3d4321f-436d-4480-b6cc-07c63c447cb7 successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Temporary image 052187e4-f9b0-4ab2-bf54-351fdb1df836 for user 053df8ad5db04919baac626732e61022 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Marking volume e3d4321f-436d-4480-b6cc-07c63c447cb7 as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Copying metadata from image 052187e4-f9b0-4ab2-bf54-351fdb1df836 to e3d4321f-436d-4480-b6cc-07c63c447cb7. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:25:29 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Creating volume glance metadata for volume e3d4321f-436d-4480-b6cc-07c63c447cb7 backed by image 052187e4-f9b0-4ab2-bf54-351fdb1df836 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:25:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5d959d-b73c-4431-9f85-b291147e1f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d4321f-436d-4480-b6cc-07c63c447cb7', 'volume_size': 1, 'image_id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/052187e4-f9b0-4ab2-bf54-351fdb1df836', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd86f6828b79d4f01b8d0819000d2e0a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '052187e4-f9b0-4ab2-bf54-351fdb1df836', 'created_at': datetime.datetime(2026, 9, 28, 16, 1, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 1, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/052187e4-f9b0-4ab2-bf54-351fdb1df836/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a62bfd-d0e5-4020-81e7-98d2af034d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:30 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Volume volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 (e3d4321f-436d-4480-b6cc-07c63c447cb7): created successfully Sep 28 18:25:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a62bfd-d0e5-4020-81e7-98d2af034d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (5a49671d-abaf-43fc-8c51-1a1ff0723142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-09b78efc-3660-42c7-bf6e-7ca2c9d20c0f tempest-VolumesGetTest-977381580 None] Created volume successfully. Sep 28 18:25:31 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (9025365d-08de-4570-9e5e-dbbb1773ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3e4698-d816-42c2-92c8-57499d881ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3e4698-d816-42c2-92c8-57499d881ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748231405',display_name='tempest-VolumesGetTest-Volume-709238330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254fbf2c-39c6-4b02-96e4-aae42feb84d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:32Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f968341c-f279-41a7-a5ae-6b995528ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f968341c-f279-41a7-a5ae-6b995528ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cc78c7-e8c3-4902-9302-6bd357ac0615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cc78c7-e8c3-4902-9302-6bd357ac0615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254fbf2c-39c6-4b02-96e4-aae42feb84d3', 'volume_name': 'volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7becf17a-7bea-4a3c-a037-12825c45c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7becf17a-7bea-4a3c-a037-12825c45c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7da05d8-26c2-4cb8-9ed1-7391d7458516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Volume 254fbf2c-39c6-4b02-96e4-aae42feb84d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3', 'volume_size': 1} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748231405',display_name='tempest-VolumesGetTest-Volume-709238330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254fbf2c-39c6-4b02-96e4-aae42feb84d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c2797ea365846f59d7b1192020807ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:32Z,use_quota=True,user_id='053df8ad5db04919baac626732e61022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Creating volume 254fbf2c-39c6-4b02-96e4-aae42feb84d3 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:32 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:32 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 1073741824 Sep 28 18:25:32 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:32 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 1073741824" returned: 0 in 0.483s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:32 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 Sep 28 18:25:32 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:32 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3" returned: 0 in 0.267s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7da05d8-26c2-4cb8-9ed1-7391d7458516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93714a8e-d63f-4558-b22c-f6770772534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:32 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Volume volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 (254fbf2c-39c6-4b02-96e4-aae42feb84d3): created successfully Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93714a8e-d63f-4558-b22c-f6770772534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:32 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Flow 'volume_create_manager' (9025365d-08de-4570-9e5e-dbbb1773ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:32 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f45bab33-3a23-4661-9bb8-8a90bbdf5fd2 tempest-VolumesGetTest-977381580 None] Created volume successfully. Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-254fbf2c-39c6-4b02-96e4-aae42feb84d3-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Lock "cinder-254fbf2c-39c6-4b02-96e4-aae42feb84d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-254fbf2c-39c6-4b02-96e4-aae42feb84d3" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-254fbf2c-39c6-4b02-96e4-aae42feb84d3" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b2be0-8b32-4e9b-bd50-5fa68e7266d6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 Sep 28 18:25:34 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3" returned: 0 in 0.456s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3 Sep 28 18:25:34 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:35 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-254fbf2c-39c6-4b02-96e4-aae42feb84d3" returned: 0 in 0.309s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-254fbf2c-39c6-4b02-96e4-aae42feb84d3" released by "delete_volume" :: held 0.834s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Created reservations ['1a7e33c8-2cbe-42dd-ab1e-7a9d895aa937', '94639124-5fad-498a-805b-7c52aa037a0e', '31278662-575a-431c-bc2e-0b38d47bb2cb', '6455a5a1-6d52-4077-91ed-cb0ea9716269'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:35 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:35 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-e3d4321f-436d-4480-b6cc-07c63c447cb7-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Lock "cinder-e3d4321f-436d-4480-b6cc-07c63c447cb7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Acquiring lock "cinder-quobyte-e3d4321f-436d-4480-b6cc-07c63c447cb7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:35 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.475s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-e3d4321f-436d-4480-b6cc-07c63c447cb7" acquired by "delete_volume" :: waited 0.059s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Deleted volume successfully. Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1332dcd6-c9e4-45a8-930b-d436feff544f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-188c8fe6-5ea1-4109-8674-ca6ea82528c0 tempest-VolumesGetTest-977381580 None] Lock "cinder-254fbf2c-39c6-4b02-96e4-aae42feb84d3-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:36 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 Sep 28 18:25:36 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7" returned: 0 in 0.688s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:36 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7 Sep 28 18:25:36 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3d4321f-436d-4480-b6cc-07c63c447cb7" returned: 0 in 0.333s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Lock "cinder-quobyte-e3d4321f-436d-4480-b6cc-07c63c447cb7" released by "delete_volume" :: held 1.102s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:36 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Created reservations ['ea591c0f-6588-49b1-aca1-151b1a88d80f', '888c5299-c141-4f8f-8806-383662ea6522', 'f9dd85b9-463e-438a-a3aa-919d0e0bfb77', '0d279639-8217-4a31-837d-9e008a806b90'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:37 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.283s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Deleted volume successfully. Sep 28 18:25:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13e86395-0b03-4c11-b1f8-2f39bb3ae966 tempest-VolumesGetTest-977381580 None] Lock "cinder-e3d4321f-436d-4480-b6cc-07c63c447cb7-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:38 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:38 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.299s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:25:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=80,cinder:INSERT=33,cinder:UPDATE=99,cinder:DELETE=8 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Flow 'volume_create_manager' (58a42a58-f6ec-4b06-a6e6-5e1fac8b18cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118a7ee4-6981-45cf-8150-0a65581b1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118a7ee4-6981-45cf-8150-0a65581b1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1400321986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56220c6c-442d-4919-b4f1-cfea39c317d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c61cae7c31d4094be9efba4f412dfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:42Z,use_quota=True,user_id='29a4f6cd88b64416bac90ce7b62abad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b99ae6c-d688-4e0f-ab17-76e41a5b657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b99ae6c-d688-4e0f-ab17-76e41a5b657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff91ee-8438-4a89-bfc6-d70bef65c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff91ee-8438-4a89-bfc6-d70bef65c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56220c6c-442d-4919-b4f1-cfea39c317d0', 'volume_name': 'volume-56220c6c-442d-4919-b4f1-cfea39c317d0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f41dab-ea65-4939-a9b9-459f04f3c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f41dab-ea65-4939-a9b9-459f04f3c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdfaea7-443e-498f-b8dc-539d56683f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:42 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Volume 56220c6c-442d-4919-b4f1-cfea39c317d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56220c6c-442d-4919-b4f1-cfea39c317d0', 'volume_size': 1} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1400321986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56220c6c-442d-4919-b4f1-cfea39c317d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c61cae7c31d4094be9efba4f412dfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:42Z,use_quota=True,user_id='29a4f6cd88b64416bac90ce7b62abad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Creating volume 56220c6c-442d-4919-b4f1-cfea39c317d0 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:42 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 1073741824 Sep 28 18:25:42 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 1073741824" returned: 0 in 0.432s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 Sep 28 18:25:42 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:43 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0" returned: 0 in 0.262s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdfaea7-443e-498f-b8dc-539d56683f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56220c6c-442d-4919-b4f1-cfea39c317d0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994497ed-03dc-4b29-8345-48a2d192fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:43 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Volume volume-56220c6c-442d-4919-b4f1-cfea39c317d0 (56220c6c-442d-4919-b4f1-cfea39c317d0): created successfully Sep 28 18:25:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994497ed-03dc-4b29-8345-48a2d192fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:43 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Flow 'volume_create_manager' (58a42a58-f6ec-4b06-a6e6-5e1fac8b18cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8bf04503-e6b3-44bc-a3a3-1b19f2e3587a tempest-VolumesListTestJSON-1758307145 None] Created volume successfully. Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Flow 'volume_create_manager' (fda96965-7994-4185-9792-086d24ff4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771c73e3-8014-4465-91b2-9a62eff541d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771c73e3-8014-4465-91b2-9a62eff541d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1004679393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4749c53-7880-406b-97f7-65b0d1409969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c61cae7c31d4094be9efba4f412dfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:45Z,use_quota=True,user_id='29a4f6cd88b64416bac90ce7b62abad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbeb6ea3-36bb-4f5f-b29f-023ed21d73cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbeb6ea3-36bb-4f5f-b29f-023ed21d73cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33d607-199d-49c7-bd83-cb495041d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33d607-199d-49c7-bd83-cb495041d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4749c53-7880-406b-97f7-65b0d1409969', 'volume_name': 'volume-a4749c53-7880-406b-97f7-65b0d1409969', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2b9f06-d6bd-41d8-98a7-c8e12de68ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2b9f06-d6bd-41d8-98a7-c8e12de68ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a97fa5-69e2-4612-be52-8d990e6f1d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Volume a4749c53-7880-406b-97f7-65b0d1409969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4749c53-7880-406b-97f7-65b0d1409969', 'volume_size': 1} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1004679393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4749c53-7880-406b-97f7-65b0d1409969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c61cae7c31d4094be9efba4f412dfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:45Z,use_quota=True,user_id='29a4f6cd88b64416bac90ce7b62abad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Creating volume a4749c53-7880-406b-97f7-65b0d1409969 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:45 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:45 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 1073741824 Sep 28 18:25:45 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:45 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 1073741824" returned: 0 in 0.457s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:45 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 Sep 28 18:25:45 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:45 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969" returned: 0 in 0.279s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a97fa5-69e2-4612-be52-8d990e6f1d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4749c53-7880-406b-97f7-65b0d1409969', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7027bb2c-6dd3-4f4f-bbb9-c49b8870fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Volume volume-a4749c53-7880-406b-97f7-65b0d1409969 (a4749c53-7880-406b-97f7-65b0d1409969): created successfully Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7027bb2c-6dd3-4f4f-bbb9-c49b8870fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Flow 'volume_create_manager' (fda96965-7994-4185-9792-086d24ff4386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:45 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f432723b-e383-4732-a58c-edc92af1e85a tempest-VolumesListTestJSON-1758307145 None] Created volume successfully. Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Flow 'volume_create_manager' (a0d8da34-72e7-471d-a531-559752fd6a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8056a2a3-e2b2-4bc7-a1a3-fade10b3d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8056a2a3-e2b2-4bc7-a1a3-fade10b3d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1569729943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deda0fc-d7ac-4e1d-9b26-a75f22421e8f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c61cae7c31d4094be9efba4f412dfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:47Z,use_quota=True,user_id='29a4f6cd88b64416bac90ce7b62abad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1ea3ed-6cf0-44c8-8885-883afb5d1490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1ea3ed-6cf0-44c8-8885-883afb5d1490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d5dacd-c3e9-43d5-ba75-938cac75728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d5dacd-c3e9-43d5-ba75-938cac75728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8deda0fc-d7ac-4e1d-9b26-a75f22421e8f', 'volume_name': 'volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e20f67-da79-4df8-9443-6735740dde42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e20f67-da79-4df8-9443-6735740dde42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03c06e8-98b3-4cc8-b3ea-6bb2c59948de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Volume 8deda0fc-d7ac-4e1d-9b26-a75f22421e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f', 'volume_size': 1} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1569729943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deda0fc-d7ac-4e1d-9b26-a75f22421e8f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c61cae7c31d4094be9efba4f412dfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:47Z,use_quota=True,user_id='29a4f6cd88b64416bac90ce7b62abad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Creating volume 8deda0fc-d7ac-4e1d-9b26-a75f22421e8f {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:47 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:25:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:47 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f 1073741824 Sep 28 18:25:47 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f 1073741824" returned: 0 in 0.422s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f Sep 28 18:25:48 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f" returned: 0 in 0.288s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03c06e8-98b3-4cc8-b3ea-6bb2c59948de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7629d63-35be-4f77-bfb6-db4bbe812205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:48 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Volume volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f (8deda0fc-d7ac-4e1d-9b26-a75f22421e8f): created successfully Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7629d63-35be-4f77-bfb6-db4bbe812205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Flow 'volume_create_manager' (a0d8da34-72e7-471d-a531-559752fd6a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-90432ffc-583c-4a4d-95e9-afa48d329fa9 tempest-VolumesListTestJSON-1758307145 None] Created volume successfully. Sep 28 18:25:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "cinder-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "cinder-quobyte-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-quobyte-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[24125ed6-5b4c-47b8-bead-79f5cdd6baf7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:50 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f Sep 28 18:25:50 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f" returned: 0 in 0.386s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f Sep 28 18:25:51 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f" returned: 0 in 0.283s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-quobyte-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f" released by "delete_volume" :: held 0.712s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Created reservations ['e2cd03aa-1f47-44fd-9f25-f0e98aba8de8', 'c5fa79f8-80b7-4f21-a00f-ccbfe1c53a43', '088a17f4-7bc5-404b-91f8-4898e4edf0de', 'f292fa3c-2774-477b-bd58-900adc1bbaa2'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:51 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.245s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Deleted volume successfully. Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-db64fc3c-63f8-491a-8e0a-8f47fcabfbce tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-8deda0fc-d7ac-4e1d-9b26-a75f22421e8f-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "cinder-a4749c53-7880-406b-97f7-65b0d1409969-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-a4749c53-7880-406b-97f7-65b0d1409969-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "cinder-quobyte-a4749c53-7880-406b-97f7-65b0d1409969" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-quobyte-a4749c53-7880-406b-97f7-65b0d1409969" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778002e-5335-4cdf-8922-833305b0e2f4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:52 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 Sep 28 18:25:52 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:52 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:52 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969 Sep 28 18:25:52 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:52 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a4749c53-7880-406b-97f7-65b0d1409969" returned: 0 in 0.251s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-quobyte-a4749c53-7880-406b-97f7-65b0d1409969" released by "delete_volume" :: held 0.699s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Created reservations ['f28af678-8bec-41a3-9ff3-5f8e7b6291fa', '5e0e2d0a-96ca-4359-be7a-dd6394e047ec', 'ddc968dd-3d19-4e05-9791-21bdbce8c571', 'd903e0e6-b522-4bcc-9f44-a8038acaa73f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:52 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:52 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.285s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Deleted volume successfully. Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0eb29453-180f-41ce-9038-1906d91a49bf tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-a4749c53-7880-406b-97f7-65b0d1409969-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "cinder-56220c6c-442d-4919-b4f1-cfea39c317d0-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-56220c6c-442d-4919-b4f1-cfea39c317d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "cinder-quobyte-56220c6c-442d-4919-b4f1-cfea39c317d0" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-quobyte-56220c6c-442d-4919-b4f1-cfea39c317d0" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3367b9eb-a87a-4aa9-a393-9d38e8f7daa5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 Sep 28 18:25:53 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0" returned: 0 in 0.388s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0 Sep 28 18:25:53 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-56220c6c-442d-4919-b4f1-cfea39c317d0" returned: 0 in 0.255s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-quobyte-56220c6c-442d-4919-b4f1-cfea39c317d0" released by "delete_volume" :: held 0.713s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Created reservations ['ec7250e5-cedb-486a-9305-0f3386b56b46', 'dcd35859-ab47-4bb0-bc3e-68d8d7b628f7', '9314376f-e0b1-42b8-be9b-6ddc9b8c6d4e', 'd321220d-0d1b-438c-9f03-3db18e3f17e3'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:25:54 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:54 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.291s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Deleted volume successfully. Sep 28 18:25:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-08575aa9-373b-4333-98d6-961d19b40479 tempest-VolumesListTestJSON-1758307145 None] Lock "cinder-56220c6c-442d-4919-b4f1-cfea39c317d0-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Flow 'volume_create_manager' (914c758b-ff3e-45d6-9cfe-4aafbac83172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a52f1c-3a04-40f6-b99b-dc156c488cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a52f1c-3a04-40f6-b99b-dc156c488cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2103055992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef3002d-7b24-486b-bc03-e256a2e26d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c60522113f847d0bb9f89f2a803efb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:57Z,use_quota=True,user_id='62159604a36a4015bd298bc48d3b9d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e62d1d-1889-4e74-9aef-42c37966bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e62d1d-1889-4e74-9aef-42c37966bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00545e87-bcb8-4cde-92c9-e9d6a88d02dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00545e87-bcb8-4cde-92c9-e9d6a88d02dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef3002d-7b24-486b-bc03-e256a2e26d91', 'volume_name': 'volume-fef3002d-7b24-486b-bc03-e256a2e26d91', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414f0c5-3281-4bc4-b83f-87922c4a2018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414f0c5-3281-4bc4-b83f-87922c4a2018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7986afc0-1396-4372-9dc0-739e4ae499b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Volume fef3002d-7b24-486b-bc03-e256a2e26d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef3002d-7b24-486b-bc03-e256a2e26d91', 'volume_size': 1} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2103055992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef3002d-7b24-486b-bc03-e256a2e26d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c60522113f847d0bb9f89f2a803efb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:57Z,use_quota=True,user_id='62159604a36a4015bd298bc48d3b9d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Creating volume fef3002d-7b24-486b-bc03-e256a2e26d91 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:57 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:57 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 1073741824 Sep 28 18:25:57 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:57 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 1073741824" returned: 0 in 0.585s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:57 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 Sep 28 18:25:57 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:58 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7986afc0-1396-4372-9dc0-739e4ae499b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef3002d-7b24-486b-bc03-e256a2e26d91', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb6256a-7a50-4771-ba83-a747eed14cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:58 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Volume volume-fef3002d-7b24-486b-bc03-e256a2e26d91 (fef3002d-7b24-486b-bc03-e256a2e26d91): created successfully Sep 28 18:25:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb6256a-7a50-4771-ba83-a747eed14cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Flow 'volume_create_manager' (914c758b-ff3e-45d6-9cfe-4aafbac83172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9d284fd0-8776-45bc-aa1d-f09cecd3b0af tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Created volume successfully. Sep 28 18:26:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-9a273188-b452-482e-846d-34a9807f50e9 req-ff666643-4b27-488c-9b86-c36444e7394a tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-9a273188-b452-482e-846d-34a9807f50e9 req-ff666643-4b27-488c-9b86-c36444e7394a tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-9a273188-b452-482e-846d-34a9807f50e9 req-ff666643-4b27-488c-9b86-c36444e7394a tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-9a273188-b452-482e-846d-34a9807f50e9 req-ff666643-4b27-488c-9b86-c36444e7394a tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-fef3002d-7b24-486b-bc03-e256a2e26d91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce088212-d082-4168-aa24-4bdf163f287b', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:26:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-9a273188-b452-482e-846d-34a9807f50e9 req-ff666643-4b27-488c-9b86-c36444e7394a tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] attachment_update completed successfully. Sep 28 18:26:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-cc5799d9-2dcb-4e6c-acbe-ff92bfee5663 req-6b482fdf-4fc3-4853-9949-8af3c2848c70 tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Terminate volume connection completed successfully. Sep 28 18:26:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-cc5799d9-2dcb-4e6c-acbe-ff92bfee5663 req-6b482fdf-4fc3-4853-9949-8af3c2848c70 tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Deleting attachment ce088212-d082-4168-aa24-4bdf163f287b. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:26:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Acquiring lock "cinder-fef3002d-7b24-486b-bc03-e256a2e26d91-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "cinder-fef3002d-7b24-486b-bc03-e256a2e26d91-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Acquiring lock "cinder-quobyte-fef3002d-7b24-486b-bc03-e256a2e26d91" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "cinder-quobyte-fef3002d-7b24-486b-bc03-e256a2e26d91" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:04 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cfdfd4-5623-4301-802c-b4a4a839fec3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 Sep 28 18:26:04 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:05 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91" returned: 0 in 0.497s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91 Sep 28 18:26:05 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:05 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fef3002d-7b24-486b-bc03-e256a2e26d91" returned: 0 in 0.371s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "cinder-quobyte-fef3002d-7b24-486b-bc03-e256a2e26d91" released by "delete_volume" :: held 0.947s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Created reservations ['e39e843a-d02b-4c19-90d0-d92acc4cb8a2', '99548c48-6f60-474b-a947-8b980df8f7a6', 'd366ae82-0337-4a60-8551-2db075f12178', '265aa583-f74b-4773-898c-f9d3eeb73d5a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:26:05 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:06 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.455s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:06 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:06 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Deleted volume successfully. Sep 28 18:26:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7118e28-efea-4b69-8e71-b0bf325e6f8c tempest-TestServerVolumeAttachScenarioOldVersion-1757768788 None] Lock "cinder-fef3002d-7b24-486b-bc03-e256a2e26d91-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (dd4f4d40-f826-407d-90e1-33b44d532a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0a7b63-0988-466f-81c2-4ed030e991e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0a7b63-0988-466f-81c2-4ed030e991e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377203385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abacaf3c-ffad-4249-bad1-7348d8fe57ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:10Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ec9d0a-27de-40c2-a0a1-298d760ff83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ec9d0a-27de-40c2-a0a1-298d760ff83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4a868a-6ac1-4ed5-ab5c-066b8627cbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4a868a-6ac1-4ed5-ab5c-066b8627cbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abacaf3c-ffad-4249-bad1-7348d8fe57ae', 'volume_name': 'volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78126b38-5189-4501-9b6a-7d07eaa820e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78126b38-5189-4501-9b6a-7d07eaa820e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7f534f-60d3-470e-b4bf-34b28d72a4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:10 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Volume abacaf3c-ffad-4249-bad1-7348d8fe57ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae', 'volume_size': 1} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377203385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abacaf3c-ffad-4249-bad1-7348d8fe57ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:10Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Creating volume abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:10 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:10 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae 1073741824 Sep 28 18:26:10 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:10 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae 1073741824" returned: 0 in 0.518s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:10 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae Sep 28 18:26:10 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:11 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae" returned: 0 in 0.337s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7f534f-60d3-470e-b4bf-34b28d72a4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748c774b-041c-44ef-86d5-719b05fb45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Volume volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae (abacaf3c-ffad-4249-bad1-7348d8fe57ae): created successfully Sep 28 18:26:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748c774b-041c-44ef-86d5-719b05fb45ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (dd4f4d40-f826-407d-90e1-33b44d532a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e50ca7ab-a4ad-4883-a190-dbcdafc79751 tempest-VolumesSnapshotTestJSON-644422729 None] Created volume successfully. Sep 28 18:26:12 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=113,cinder:SELECT=80,cinder:INSERT=31,cinder:DELETE=11 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Creating offline snapshot 205cb1a0-70fa-408e-90ba-05cbca622f37 of volume abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:12 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4f1ac-e15c-44a1-86d8-bdd9a7840551]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:12 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae Sep 28 18:26:12 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae" returned: 0 in 0.435s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 1G Sep 28 18:26:13 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 1G" returned: 0 in 0.543s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 Sep 28 18:26:13 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37" returned: 0 in 0.349s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 is being set with open permissions: ugo+rw Sep 28 18:26:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 Sep 28 18:26:13 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:14 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.info Sep 28 18:26:14 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.info" returned: 0 in 0.361s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:14 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.info is being set with open permissions: ugo+rw Sep 28 18:26:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:14 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.info Sep 28 18:26:14 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.info" returned: 0 in 0.257s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8130e87f-d8d7-4e1e-bad8-c18c8b09217a tempest-VolumesSnapshotTestJSON-644422729 None] Create snapshot completed successfully Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-205cb1a0-70fa-408e-90ba-05cbca622f37-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-205cb1a0-70fa-408e-90ba-05cbca622f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-abacaf3c-ffad-4249-bad1-7348d8fe57ae" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-abacaf3c-ffad-4249-bad1-7348d8fe57ae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-205cb1a0-70fa-408e-90ba-05cbca622f37" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-205cb1a0-70fa-408e-90ba-05cbca622f37" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Deleting offline snapshot 205cb1a0-70fa-408e-90ba-05cbca622f37 of volume abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] snapshot_file for this snap is: volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f8791-db42-48ff-936e-a67a96f2d33f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 Sep 28 18:26:16 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb797769-b9ab-450e-b26b-7ef9dff25abf]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae Sep 28 18:26:16 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae" returned: 0 in 0.433s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 Sep 28 18:26:16 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37" returned: 0 in 0.392s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37 Sep 28 18:26:17 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae.205cb1a0-70fa-408e-90ba-05cbca622f37" returned: 0 in 0.253s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-205cb1a0-70fa-408e-90ba-05cbca622f37" released by "_delete_snapshot" :: held 1.624s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-abacaf3c-ffad-4249-bad1-7348d8fe57ae" released by "delete_snapshot" :: held 1.652s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['c3b4052a-97c8-4a01-a95f-dace358e3472', 'bd41365f-76b5-4bd6-a609-72ee33f8440a', '7ca441fe-fb50-4e8f-9f54-ee379ac7ef69', 'df43aebd-506b-4191-8873-378655a13ff7'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Delete snapshot completed successfully. Sep 28 18:26:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4264049-55af-46ac-aaf8-b01cf3a36b7d tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-205cb1a0-70fa-408e-90ba-05cbca622f37-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (1a5cc8aa-2445-4db7-ba98-26ad3c9c6bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d7fd91-2630-4eb8-96e6-e5e5dbe820b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d7fd91-2630-4eb8-96e6-e5e5dbe820b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1065348707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddd5d69-0bb6-4143-b376-ed2a11eb240e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:19Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19276987-6e77-4cb9-b57e-6f82f485b631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19276987-6e77-4cb9-b57e-6f82f485b631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d082f8d0-6e7c-4226-b536-58800812c79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d082f8d0-6e7c-4226-b536-58800812c79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ddd5d69-0bb6-4143-b376-ed2a11eb240e', 'volume_name': 'volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d647b2d5-1b20-4544-a308-e703b41a30d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d647b2d5-1b20-4544-a308-e703b41a30d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8790d2-f6d5-4073-a670-6166f5171bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Volume 4ddd5d69-0bb6-4143-b376-ed2a11eb240e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e', 'volume_size': 1} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1065348707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ddd5d69-0bb6-4143-b376-ed2a11eb240e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:19Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Creating volume 4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:18 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:26:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e 1073741824 Sep 28 18:26:18 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e 1073741824" returned: 0 in 0.556s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e Sep 28 18:26:19 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8790d2-f6d5-4073-a670-6166f5171bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e693ee0-111c-4104-b091-ade60db40e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Volume volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e (4ddd5d69-0bb6-4143-b376-ed2a11eb240e): created successfully Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e693ee0-111c-4104-b091-ade60db40e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (1a5cc8aa-2445-4db7-ba98-26ad3c9c6bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1e8c35af-fc52-4695-82c4-930bb8695485 tempest-VolumesSnapshotTestJSON-644422729 None] Created volume successfully. Sep 28 18:26:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Creating offline snapshot 508f44c9-687d-41b5-8983-c5e2e34c5785 of volume 4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[388cf00d-6fd5-4cbe-84ea-4221f88daef4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:21 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e Sep 28 18:26:21 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:21 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" returned: 0 in 0.431s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:21 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 1G Sep 28 18:26:21 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 1G" returned: 0 in 0.507s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 Sep 28 18:26:22 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785" returned: 0 in 0.314s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 is being set with open permissions: ugo+rw Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 Sep 28 18:26:22 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785" returned: 0 in 0.270s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.info Sep 28 18:26:22 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.info" returned: 0 in 0.263s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.info is being set with open permissions: ugo+rw Sep 28 18:26:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.info Sep 28 18:26:22 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.info" returned: 0 in 0.381s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8f1cd8cb-03f6-4007-b3f2-07e3a4d52e1f tempest-VolumesSnapshotTestJSON-644422729 None] Create snapshot completed successfully Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (4c415548-c9d8-45e4-a4dc-e42fee266eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5791cd96-31a9-47de-8a70-42bf7dbf5c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5791cd96-31a9-47de-8a70-42bf7dbf5c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-813727273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fba246-3e3d-4b88-b546-cde47f47d359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=508f44c9-687d-41b5-8983-c5e2e34c5785,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:25Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c42fdb-a62b-4940-a1dd-6af1841cf9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c42fdb-a62b-4940-a1dd-6af1841cf9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036be6f3-4e7b-44bc-8187-8ddf711edeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036be6f3-4e7b-44bc-8187-8ddf711edeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4fba246-3e3d-4b88-b546-cde47f47d359', 'volume_name': 'volume-b4fba246-3e3d-4b88-b546-cde47f47d359', 'volume_size': 2, 'snapshot_id': '508f44c9-687d-41b5-8983-c5e2e34c5785'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3096a0-c28f-4e5b-93a0-8a41ec077234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3096a0-c28f-4e5b-93a0-8a41ec077234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72be27e-8d34-4804-95e6-d718c7176145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:24 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Volume b4fba246-3e3d-4b88-b546-cde47f47d359: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4fba246-3e3d-4b88-b546-cde47f47d359', 'volume_size': 2, 'snapshot_id': '508f44c9-687d-41b5-8983-c5e2e34c5785'} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-508f44c9-687d-41b5-8983-c5e2e34c5785-b4fba246-3e3d-4b88-b546-cde47f47d359" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-508f44c9-687d-41b5-8983-c5e2e34c5785-b4fba246-3e3d-4b88-b546-cde47f47d359" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Creating volume b4fba246-3e3d-4b88-b546-cde47f47d359 from snapshot 508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-b4fba246-3e3d-4b88-b546-cde47f47d359" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-b4fba246-3e3d-4b88-b546-cde47f47d359" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] snapshot: 508f44c9-687d-41b5-8983-c5e2e34c5785, volume: b4fba246-3e3d-4b88-b546-cde47f47d359, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f5cee-9003-4b3b-be62-d05ef36d0707]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:25 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 Sep 28 18:26:25 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:25 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785" returned: 0 in 0.424s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee44295c-715a-4fce-9a8a-a161284dd437]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:25 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e Sep 28 18:26:25 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:26 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" returned: 0 in 0.501s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:26:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:26:26 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:26:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:26 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 Sep 28 18:26:26 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:33 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359" returned: 0 in 7.180s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:26:33 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Converted 1024.00 MB image at 142.59 MB/s Sep 28 18:26:33 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 is being set with open permissions: ugo+rw Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:33 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 Sep 28 18:26:33 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:33 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359" returned: 0 in 0.256s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-b4fba246-3e3d-4b88-b546-cde47f47d359" released by "_copy_volume_from_snapshot" :: held 8.481s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-508f44c9-687d-41b5-8983-c5e2e34c5785-b4fba246-3e3d-4b88-b546-cde47f47d359" released by "_create_volume_from_snapshot" :: held 8.555s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.570s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72be27e-8d34-4804-95e6-d718c7176145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4fba246-3e3d-4b88-b546-cde47f47d359', 'volume_size': 2, 'snapshot_id': '508f44c9-687d-41b5-8983-c5e2e34c5785'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f27e51d-259d-4bb8-a2c7-34fd12816e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:33 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Volume volume-b4fba246-3e3d-4b88-b546-cde47f47d359 (b4fba246-3e3d-4b88-b546-cde47f47d359): created successfully Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f27e51d-259d-4bb8-a2c7-34fd12816e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (4c415548-c9d8-45e4-a4dc-e42fee266eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f6d973d0-01f5-44e8-a6ec-f6bb5d778cc1 tempest-VolumesSnapshotTestJSON-644422729 None] Created volume successfully. Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-b4fba246-3e3d-4b88-b546-cde47f47d359-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-b4fba246-3e3d-4b88-b546-cde47f47d359-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-b4fba246-3e3d-4b88-b546-cde47f47d359" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-b4fba246-3e3d-4b88-b546-cde47f47d359" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[93327c6f-b022-42f9-ae56-c4e06eb1278c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:34 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 Sep 28 18:26:34 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:34 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359" returned: 0 in 0.432s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:34 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359 Sep 28 18:26:34 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:34 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b4fba246-3e3d-4b88-b546-cde47f47d359" returned: 0 in 0.264s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-b4fba246-3e3d-4b88-b546-cde47f47d359" released by "delete_volume" :: held 0.753s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['73a040c0-982f-47d0-86bb-361ee5847024', '4df832ce-60c9-47d9-94b1-35e4e0056195', 'c8ebe369-273d-4f6a-a639-fbd53a137f7d', '7bc7a9bb-022f-4efa-bc9f-ebb9d0d0c71c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:34 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:26:34 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:35 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.262s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Deleted volume successfully. Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-508f44c9-687d-41b5-8983-c5e2e34c5785-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-734142ea-9811-4367-bcd5-82a28b62bd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-b4fba246-3e3d-4b88-b546-cde47f47d359-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-508f44c9-687d-41b5-8983-c5e2e34c5785-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-508f44c9-687d-41b5-8983-c5e2e34c5785" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-508f44c9-687d-41b5-8983-c5e2e34c5785" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Deleting offline snapshot 508f44c9-687d-41b5-8983-c5e2e34c5785 of volume 4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] snapshot_file for this snap is: volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb34ad-f5b3-44b4-a60c-d820e0e35e07]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:35 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 Sep 28 18:26:35 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:35 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c793daff-cf7f-439b-a581-b53ae95256c6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:35 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e Sep 28 18:26:35 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:36 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" returned: 0 in 0.629s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:36 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 Sep 28 18:26:36 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:36 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785" returned: 0 in 0.364s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:36 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785 Sep 28 18:26:36 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:36 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e.508f44c9-687d-41b5-8983-c5e2e34c5785" returned: 0 in 0.266s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-508f44c9-687d-41b5-8983-c5e2e34c5785" released by "_delete_snapshot" :: held 1.785s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" released by "delete_snapshot" :: held 1.815s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['99c22585-0e7f-4166-b31a-d124198ed4d7', '7cbfdb28-3130-40a0-9ec8-98e4c43a12cd', '59992972-16d0-4356-aae5-38556185ad72', '78ae8ba6-3ed8-464e-b5fb-29d6342f2464'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Delete snapshot completed successfully. Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-72e71d89-ac28-4e63-bada-27429420b7be tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-508f44c9-687d-41b5-8983-c5e2e34c5785-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-4ddd5d69-0bb6-4143-b376-ed2a11eb240e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-4ddd5d69-0bb6-4143-b376-ed2a11eb240e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" acquired by "delete_volume" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b9247-b151-461f-aa2c-b1b5d1c1668e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:37 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e Sep 28 18:26:37 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:38 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" returned: 0 in 0.500s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:38 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e Sep 28 18:26:38 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:38 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" returned: 0 in 0.380s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-4ddd5d69-0bb6-4143-b376-ed2a11eb240e" released by "delete_volume" :: held 0.975s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['f7151057-c856-4f38-99a8-b4681db1866b', '20fa047f-c597-494e-a567-2223c3838e3d', '3d3fe59b-aa63-4a53-b75b-0158aa24aa30', '1f8a8e95-7adf-4812-b950-75d0c288dd9c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:38 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:26:38 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:38 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:26:38 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:39 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.350s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:39 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Deleted volume successfully. Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1be24d99-ff8b-4ef4-91de-8cc878d8dd27 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-4ddd5d69-0bb6-4143-b376-ed2a11eb240e-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:39 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.404s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:26:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (1d6c26fe-83cf-4026-aa6a-95b4e7f3e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e75145-967c-4284-a180-25eabd05ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e75145-967c-4284-a180-25eabd05ac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1210829359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac04056-0aa0-4374-8529-1d7402629587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:40Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef74ac9b-ff31-4581-9708-6531fc30ae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef74ac9b-ff31-4581-9708-6531fc30ae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc57a026-0e26-4123-b01b-8d2fe03a980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc57a026-0e26-4123-b01b-8d2fe03a980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac04056-0aa0-4374-8529-1d7402629587', 'volume_name': 'volume-6ac04056-0aa0-4374-8529-1d7402629587', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041ee7d-4e17-42cb-98ec-c9d2bc82a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a041ee7d-4e17-42cb-98ec-c9d2bc82a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dad7c95-fbaa-483c-9263-bbad8a24bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:40 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Volume 6ac04056-0aa0-4374-8529-1d7402629587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac04056-0aa0-4374-8529-1d7402629587', 'volume_size': 1} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1210829359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac04056-0aa0-4374-8529-1d7402629587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:40Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Creating volume 6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:40 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:26:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:40 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 1073741824 Sep 28 18:26:40 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:41 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 1073741824" returned: 0 in 0.616s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:41 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 Sep 28 18:26:41 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:41 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587" returned: 0 in 0.338s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dad7c95-fbaa-483c-9263-bbad8a24bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac04056-0aa0-4374-8529-1d7402629587', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78bf7bb-80f1-4dec-9b9b-246cd0ae4b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:41 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Volume volume-6ac04056-0aa0-4374-8529-1d7402629587 (6ac04056-0aa0-4374-8529-1d7402629587): created successfully Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78bf7bb-80f1-4dec-9b9b-246cd0ae4b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:41 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (1d6c26fe-83cf-4026-aa6a-95b4e7f3e14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:41 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9c29ab50-5e2c-4c1f-a540-a20b16383828 tempest-VolumesSnapshotTestJSON-644422729 None] Created volume successfully. Sep 28 18:26:42 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=79,cinder:INSERT=21,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Creating offline snapshot 45781ec3-3675-495e-a343-d6da8c7563a5 of volume 6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb81b44-ebcc-48c1-b2f2-7ef4bed6ceb3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:42 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 Sep 28 18:26:42 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:43 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587" returned: 0 in 0.507s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:43 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 1G Sep 28 18:26:43 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:43 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 1G" returned: 0 in 0.461s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac04056-0aa0-4374-8529-1d7402629587 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:43 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac04056-0aa0-4374-8529-1d7402629587 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 Sep 28 18:26:43 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:43 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac04056-0aa0-4374-8529-1d7402629587 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5" returned: 0 in 0.305s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:43 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 is being set with open permissions: ugo+rw Sep 28 18:26:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:43 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 Sep 28 18:26:43 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:44 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5" returned: 0 in 0.291s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:44 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.info Sep 28 18:26:44 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:44 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.info" returned: 0 in 0.276s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:44 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.info is being set with open permissions: ugo+rw Sep 28 18:26:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:44 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.info Sep 28 18:26:44 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:44 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.info" returned: 0 in 0.301s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:44 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1d247b5d-efe8-4b16-8de0-dee2e57ce14a tempest-VolumesSnapshotTestJSON-644422729 None] Create snapshot completed successfully Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (a0f0a38b-22aa-4369-b58a-28bf8cfb027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11081319-181e-43aa-8774-feb16e6eddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11081319-181e-43aa-8774-feb16e6eddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1286861711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d562041e65974925b8ec4067f06bbe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45781ec3-3675-495e-a343-d6da8c7563a5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:46Z,use_quota=True,user_id='147020885e57468e97ee4b78f50b5a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbee795-5ffd-48fd-9e48-71822f65a389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbee795-5ffd-48fd-9e48-71822f65a389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9485cc1-1c52-4ed7-a2e9-cf21363fbbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9485cc1-1c52-4ed7-a2e9-cf21363fbbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6', 'volume_name': 'volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6', 'volume_size': 1, 'snapshot_id': '45781ec3-3675-495e-a343-d6da8c7563a5'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633cbbc7-30d5-41eb-b98a-466b53232f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633cbbc7-30d5-41eb-b98a-466b53232f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecfd03f-5368-48ec-9b3c-722ea89d77e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:46 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Volume db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6', 'volume_size': 1, 'snapshot_id': '45781ec3-3675-495e-a343-d6da8c7563a5'} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-45781ec3-3675-495e-a343-d6da8c7563a5-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-45781ec3-3675-495e-a343-d6da8c7563a5-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Creating volume db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 from snapshot 45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] snapshot: 45781ec3-3675-495e-a343-d6da8c7563a5, volume: db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[90be47fc-1f31-42eb-b1c8-d6a7e7e73fe8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:46 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 Sep 28 18:26:46 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:47 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5" returned: 0 in 0.467s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ac04056-0aa0-4374-8529-1d7402629587(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4e7349-c8ae-4c9e-b3c3-af733cdb3271]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:47 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 Sep 28 18:26:47 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:47 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587" returned: 0 in 0.428s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:26:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:47 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 Sep 28 18:26:47 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:55 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" returned: 0 in 8.208s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:55 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:26:55 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Converted 1024.00 MB image at 124.73 MB/s Sep 28 18:26:56 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 is being set with open permissions: ugo+rw Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:56 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 Sep 28 18:26:56 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:56 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" returned: 0 in 0.279s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" released by "_copy_volume_from_snapshot" :: held 9.598s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-45781ec3-3675-495e-a343-d6da8c7563a5-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" released by "_create_volume_from_snapshot" :: held 9.699s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.733s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecfd03f-5368-48ec-9b3c-722ea89d77e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6', 'volume_size': 1, 'snapshot_id': '45781ec3-3675-495e-a343-d6da8c7563a5'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653a5f5e-c6df-421b-b3f5-35ac0a01e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:56 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Volume volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 (db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6): created successfully Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653a5f5e-c6df-421b-b3f5-35ac0a01e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Flow 'volume_create_manager' (a0f0a38b-22aa-4369-b58a-28bf8cfb027e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-430e2de5-d72e-4b42-b6f8-a804672d53e6 tempest-VolumesSnapshotTestJSON-644422729 None] Created volume successfully. Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0324d1-f4ef-4a5b-bdda-105b46885433]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:56 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 Sep 28 18:26:56 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" returned: 0 in 0.395s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6 Sep 28 18:26:57 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" returned: 0 in 0.288s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6" released by "delete_volume" :: held 0.727s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['2e30c77b-20f4-46bb-9006-fa1154f97fe2', 'c245e3fa-fd95-45e2-bb31-d9254ff63945', '2c371e79-95c9-4846-a398-7eca8a83fd2a', '880b76af-d41f-41b9-8268-d3067f522ac2'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:26:57 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-45781ec3-3675-495e-a343-d6da8c7563a5-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.325s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Deleted volume successfully. Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-45781ec3-3675-495e-a343-d6da8c7563a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-6ac04056-0aa0-4374-8529-1d7402629587" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-be2b07e3-4c60-42b0-8865-5155681c239b tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-db08ea20-c6a2-4ba2-a5b3-fec118ba3fc6-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-6ac04056-0aa0-4374-8529-1d7402629587" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-45781ec3-3675-495e-a343-d6da8c7563a5" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-45781ec3-3675-495e-a343-d6da8c7563a5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Deleting offline snapshot 45781ec3-3675-495e-a343-d6da8c7563a5 of volume 6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] snapshot_file for this snap is: volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7db2cf-1866-4c6d-b1da-518b333aff96]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 Sep 28 18:26:58 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5" returned: 0 in 0.449s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ac04056-0aa0-4374-8529-1d7402629587(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa49863-6716-41c8-8d62-9944628449a7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 Sep 28 18:26:58 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587" returned: 0 in 0.603s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 Sep 28 18:26:59 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5" returned: 0 in 0.379s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5 Sep 28 18:26:59 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587.45781ec3-3675-495e-a343-d6da8c7563a5" returned: 0 in 0.292s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-45781ec3-3675-495e-a343-d6da8c7563a5" released by "_delete_snapshot" :: held 1.869s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-6ac04056-0aa0-4374-8529-1d7402629587" released by "delete_snapshot" :: held 1.904s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['44a39b70-cde8-4d9c-ab1d-3fb3331fffc4', '51f4e6e0-093d-4dc8-af14-a1588905218a', '0ea95201-9107-4b32-9d67-93094be61697', 'd1fa8ad9-d32e-4f1d-a3f8-8b6bff2ffc3f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Delete snapshot completed successfully. Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ede9d6fb-862e-444c-b8a7-70a147fd9272 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-45781ec3-3675-495e-a343-d6da8c7563a5-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Flow 'volume_create_manager' (efff3928-62de-4fd6-b9f1-714424af6b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7a2eef-18f3-4bdf-94d0-bd25491bdb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7a2eef-18f3-4bdf-94d0-bd25491bdb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1388620593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e59701-6562-4b75-8562-01238877380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dac32f9168d499ab7516d3979a195bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:00Z,use_quota=True,user_id='485b923a48144be4b0e868426e55d896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cdccfb-aea9-40bb-adaa-762f09da2842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cdccfb-aea9-40bb-adaa-762f09da2842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60e4139-e5a1-4f68-9cbc-d727cb2d0908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60e4139-e5a1-4f68-9cbc-d727cb2d0908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e59701-6562-4b75-8562-01238877380d', 'volume_name': 'volume-17e59701-6562-4b75-8562-01238877380d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5297f4-d179-46f4-a56d-800ccf2d4dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5297f4-d179-46f4-a56d-800ccf2d4dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc6690d-73fe-4e02-ac33-c29cf6d2d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Volume 17e59701-6562-4b75-8562-01238877380d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e59701-6562-4b75-8562-01238877380d', 'volume_size': 1} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1388620593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e59701-6562-4b75-8562-01238877380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dac32f9168d499ab7516d3979a195bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:00Z,use_quota=True,user_id='485b923a48144be4b0e868426e55d896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Creating volume 17e59701-6562-4b75-8562-01238877380d {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:00 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-6ac04056-0aa0-4374-8529-1d7402629587-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:00 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d 1073741824 Sep 28 18:27:00 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-6ac04056-0aa0-4374-8529-1d7402629587-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-6ac04056-0aa0-4374-8529-1d7402629587" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-6ac04056-0aa0-4374-8529-1d7402629587" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc4c6c1-abfa-405a-b7a9-0dac6e30984b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 Sep 28 18:27:00 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:00 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d 1073741824" returned: 0 in 0.564s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d Sep 28 18:27:01 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587" returned: 0 in 0.479s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587 Sep 28 18:27:01 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d" returned: 0 in 0.345s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc6690d-73fe-4e02-ac33-c29cf6d2d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e59701-6562-4b75-8562-01238877380d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f952874c-bbf0-4aab-a8df-2084e0a2a88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:01 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Volume volume-17e59701-6562-4b75-8562-01238877380d (17e59701-6562-4b75-8562-01238877380d): created successfully Sep 28 18:27:01 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f952874c-bbf0-4aab-a8df-2084e0a2a88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Flow 'volume_create_manager' (efff3928-62de-4fd6-b9f1-714424af6b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6ac04056-0aa0-4374-8529-1d7402629587" returned: 0 in 0.352s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-6ac04056-0aa0-4374-8529-1d7402629587" released by "delete_volume" :: held 0.928s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-309438f6-7916-4cf2-85e5-e605aaf4077a tempest-TestStampPattern-1938140159 None] Created volume successfully. Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['3318a59b-acd1-4b33-aa2b-84e82c97cafd', 'd97f8fb5-6940-45f5-a838-3634364c92d7', 'ae09eed8-f25a-4982-b87e-fcb852dc2ba3', '971f9925-06bf-403f-a6df-d7911b57a363'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:27:01 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.297s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Deleted volume successfully. Sep 28 18:27:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-38e03d2a-1f44-4aea-bbe8-dfa5ebec4e25 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-6ac04056-0aa0-4374-8529-1d7402629587-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-abacaf3c-ffad-4249-bad1-7348d8fe57ae-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-abacaf3c-ffad-4249-bad1-7348d8fe57ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "cinder-quobyte-abacaf3c-ffad-4249-bad1-7348d8fe57ae" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-abacaf3c-ffad-4249-bad1-7348d8fe57ae" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9cabe4-2f6c-4eb4-88c7-b46c972cd29a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:02 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae Sep 28 18:27:02 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:03 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae" returned: 0 in 0.533s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:03 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae Sep 28 18:27:03 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:03 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-abacaf3c-ffad-4249-bad1-7348d8fe57ae" returned: 0 in 0.331s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-quobyte-abacaf3c-ffad-4249-bad1-7348d8fe57ae" released by "delete_volume" :: held 0.945s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Created reservations ['6e82ddd0-3de3-4281-bf0c-f26b759aceaf', '42d66961-889d-41e4-9df0-246b0217d681', '959b5816-59f5-4132-b416-c1103b3caf08', '72a806b4-b596-4eb0-a521-46f25553eadb'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:03 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:27:03 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:04 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.296s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:04 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Deleted volume successfully. Sep 28 18:27:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-96b92630-d3df-4c95-9201-f898e8ccdd40 tempest-VolumesSnapshotTestJSON-644422729 None] Lock "cinder-abacaf3c-ffad-4249-bad1-7348d8fe57ae-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Flow 'volume_create_manager' (0a091c41-8d83-4f27-b5d1-dc5cb8541b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309b75d0-c00b-4c6b-a376-ad61145b4d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=76,cinder:INSERT=20,cinder:UPDATE=74,cinder:DELETE=8 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309b75d0-c00b-4c6b-a376-ad61145b4d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-110801137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42b2202-2372-4a88-a408-089a18e5b207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950c2331509242888d76e8c128f1bd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:14Z,use_quota=True,user_id='f583d76900da48b6ad8916c494e9aab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b037fa-481e-4843-af20-76691d218d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b037fa-481e-4843-af20-76691d218d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b97cf17-e9b0-4f94-9954-82cd79c4896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b97cf17-e9b0-4f94-9954-82cd79c4896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42b2202-2372-4a88-a408-089a18e5b207', 'volume_name': 'volume-d42b2202-2372-4a88-a408-089a18e5b207', 'volume_size': 2}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b572eb-1223-42ab-8e9b-a6cafd662cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b572eb-1223-42ab-8e9b-a6cafd662cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac99cefb-db93-40f2-9ba4-8c15c6e34af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Volume d42b2202-2372-4a88-a408-089a18e5b207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42b2202-2372-4a88-a408-089a18e5b207', 'volume_size': 2} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-110801137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42b2202-2372-4a88-a408-089a18e5b207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950c2331509242888d76e8c128f1bd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:14Z,use_quota=True,user_id='f583d76900da48b6ad8916c494e9aab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Creating volume d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:13 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:27:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 2147483648 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:14 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 2147483648 Sep 28 18:27:14 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:14 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 2147483648" returned: 0 in 0.525s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:14 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 Sep 28 18:27:14 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:14 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207" returned: 0 in 0.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac99cefb-db93-40f2-9ba4-8c15c6e34af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42b2202-2372-4a88-a408-089a18e5b207', 'volume_size': 2}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfd3915-9a62-42b1-9243-adaf9d8b5ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:14 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Volume volume-d42b2202-2372-4a88-a408-089a18e5b207 (d42b2202-2372-4a88-a408-089a18e5b207): created successfully Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfd3915-9a62-42b1-9243-adaf9d8b5ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Flow 'volume_create_manager' (0a091c41-8d83-4f27-b5d1-dc5cb8541b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2baf66cd-ae47-408d-80d2-149aab5e2afb tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Created volume successfully. Sep 28 18:27:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Creating offline snapshot caafceb4-e0fb-41ba-890d-d3ba942cb02a of volume d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:27:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd693bb-00f7-40c5-b9b9-d694c178dad4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:16 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 Sep 28 18:27:16 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:16 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207" returned: 0 in 0.397s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a 2G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:16 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a 2G Sep 28 18:27:16 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:17 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a 2G" returned: 0 in 0.399s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d42b2202-2372-4a88-a408-089a18e5b207 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:17 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d42b2202-2372-4a88-a408-089a18e5b207 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a Sep 28 18:27:17 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:17 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d42b2202-2372-4a88-a408-089a18e5b207 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a" returned: 0 in 0.349s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:17 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a is being set with open permissions: ugo+rw Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:17 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a Sep 28 18:27:17 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:17 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a" returned: 0 in 0.244s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:17 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.info Sep 28 18:27:17 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:17 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.info" returned: 0 in 0.276s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:17 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.info is being set with open permissions: ugo+rw Sep 28 18:27:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:17 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.info Sep 28 18:27:17 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:18 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.info" returned: 0 in 0.294s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6383ef4a-5d71-4a72-8df4-dbd053cf11fa tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Create snapshot completed successfully Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "cinder-caafceb4-e0fb-41ba-890d-d3ba942cb02a-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-caafceb4-e0fb-41ba-890d-d3ba942cb02a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "cinder-quobyte-d42b2202-2372-4a88-a408-089a18e5b207" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-quobyte-d42b2202-2372-4a88-a408-089a18e5b207" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "cinder-quobyte-caafceb4-e0fb-41ba-890d-d3ba942cb02a" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-quobyte-caafceb4-e0fb-41ba-890d-d3ba942cb02a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Deleting offline snapshot caafceb4-e0fb-41ba-890d-d3ba942cb02a of volume d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] snapshot_file for this snap is: volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3732d42-49ae-4ab3-9705-78a34ebe525b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:19 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a Sep 28 18:27:19 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:19 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a" returned: 0 in 0.381s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d42b2202-2372-4a88-a408-089a18e5b207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf1b7e3-4d0e-4237-8781-fb94835d119c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:20 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 Sep 28 18:27:20 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:20 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207" returned: 0 in 0.394s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:20 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a Sep 28 18:27:20 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:20 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a" returned: 0 in 0.419s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:20 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a Sep 28 18:27:20 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:21 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207.caafceb4-e0fb-41ba-890d-d3ba942cb02a" returned: 0 in 0.268s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-quobyte-caafceb4-e0fb-41ba-890d-d3ba942cb02a" released by "_delete_snapshot" :: held 1.573s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-quobyte-d42b2202-2372-4a88-a408-089a18e5b207" released by "delete_snapshot" :: held 1.598s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Created reservations ['a96e662f-30e3-44e7-8f26-ff1fd03226c2', '6b4ad078-7b7b-4d3d-9bd2-5969d440d6e3', 'fede7ae3-d947-4697-9294-62b56bf76739', '793c86f7-6e03-4f48-9593-7e28943bf8b6'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Delete snapshot completed successfully. Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dfed5590-d702-4108-b4b7-b08573f36b16 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-caafceb4-e0fb-41ba-890d-d3ba942cb02a-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "cinder-d42b2202-2372-4a88-a408-089a18e5b207-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-d42b2202-2372-4a88-a408-089a18e5b207-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "cinder-quobyte-d42b2202-2372-4a88-a408-089a18e5b207" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-quobyte-d42b2202-2372-4a88-a408-089a18e5b207" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e3fb5d-2514-431a-a909-d20992e262fc]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:21 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 Sep 28 18:27:21 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:22 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207" returned: 0 in 0.400s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:22 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207 Sep 28 18:27:22 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:22 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-d42b2202-2372-4a88-a408-089a18e5b207" returned: 0 in 0.246s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-quobyte-d42b2202-2372-4a88-a408-089a18e5b207" released by "delete_volume" :: held 0.720s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Created reservations ['f35d5c4d-c00b-48f4-94c1-a0313f4e473b', 'a4bb34ba-3e9f-43b5-8aae-b5e1ce5eda2a', '8227a675-d75a-4cf5-9280-e396a9af6f36', '52764556-2598-476c-8ead-3c4e2ea06b98'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:22 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:27:22 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:22 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.260s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Deleted volume successfully. Sep 28 18:27:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-14e028b1-bc66-45ee-9c8c-b845c8e912c2 tempest-VolumesSnapshotNegativeTestJSON-596507607 None] Lock "cinder-d42b2202-2372-4a88-a408-089a18e5b207-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:32 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=13,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:32 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=44,cinder:UPDATE=60,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8abcdf2d-9e25-4c63-8d66-c1f61f89e6ea req-c317f534-c559-4843-904f-cbbf53c227a3 tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8abcdf2d-9e25-4c63-8d66-c1f61f89e6ea req-c317f534-c559-4843-904f-cbbf53c227a3 tempest-TestStampPattern-1938140159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-8abcdf2d-9e25-4c63-8d66-c1f61f89e6ea req-c317f534-c559-4843-904f-cbbf53c227a3 tempest-TestStampPattern-1938140159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-8abcdf2d-9e25-4c63-8d66-c1f61f89e6ea req-c317f534-c559-4843-904f-cbbf53c227a3 tempest-TestStampPattern-1938140159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-17e59701-6562-4b75-8562-01238877380d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed4eaa5c-ce31-4dbe-b9f5-af5db9284a78', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:27:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-8abcdf2d-9e25-4c63-8d66-c1f61f89e6ea req-c317f534-c559-4843-904f-cbbf53c227a3 tempest-TestStampPattern-1938140159 None] attachment_update completed successfully. Sep 28 18:27:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:38 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:27:38 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:39 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.338s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:27:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:27:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-7984bcef-000b-4c46-9d9c-2b8173fae85f req-48590363-590b-4ab8-a9b5-8dca60accb08 tempest-TestStampPattern-1938140159 None] Terminate volume connection completed successfully. Sep 28 18:27:40 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-7984bcef-000b-4c46-9d9c-2b8173fae85f req-48590363-590b-4ab8-a9b5-8dca60accb08 tempest-TestStampPattern-1938140159 None] Deleting attachment ed4eaa5c-ce31-4dbe-b9f5-af5db9284a78. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:27:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:41 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Creating offline snapshot c5efd871-abee-4d4a-9a4a-44dbb494e81b of volume 17e59701-6562-4b75-8562-01238877380d {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:27:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b1ee5-7c97-41aa-a83c-75904df23f69]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:41 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d Sep 28 18:27:41 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:41 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d" returned: 0 in 0.446s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:41 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b 1G Sep 28 18:27:41 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:42 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b 1G" returned: 0 in 0.485s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e59701-6562-4b75-8562-01238877380d -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:42 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e59701-6562-4b75-8562-01238877380d -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b Sep 28 18:27:42 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:42 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e59701-6562-4b75-8562-01238877380d -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b" returned: 0 in 0.363s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:42 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b is being set with open permissions: ugo+rw Sep 28 18:27:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:42 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b Sep 28 18:27:42 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:42 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b" returned: 0 in 0.279s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:42 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.info Sep 28 18:27:42 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:43 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.info" returned: 0 in 0.286s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:43 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.info is being set with open permissions: ugo+rw Sep 28 18:27:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:43 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.info Sep 28 18:27:43 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:43 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.info" returned: 0 in 0.309s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3a7dd1e4-38a9-45b0-a9ae-797f844d0201 tempest-TestStampPattern-1938140159 None] Create snapshot completed successfully Sep 28 18:27:49 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Flow 'volume_create_manager' (6623ca4a-84fd-4444-a2d1-67517ea71f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92238ed4-e6cf-4975-ac2b-996b5879554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92238ed4-e6cf-4975-ac2b-996b5879554c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1875546501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb5b185-20b8-43ef-8aff-1618e085fd5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ab89f02a5a49f29e287445ec479aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:50Z,use_quota=True,user_id='3dbe7750b4d0490fac97a6a695a8c7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c70902-ed79-48f5-8f31-551568e518c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c70902-ed79-48f5-8f31-551568e518c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce88817d-409b-4154-b79b-8c91cb76db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce88817d-409b-4154-b79b-8c91cb76db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb5b185-20b8-43ef-8aff-1618e085fd5f', 'volume_name': 'volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059c0561-2500-4e4f-9998-91e0077e6f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059c0561-2500-4e4f-9998-91e0077e6f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810b4293-41e6-4ce6-a8e2-3c1c0575f451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:50 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Volume ccb5b185-20b8-43ef-8aff-1618e085fd5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f', 'volume_size': 1} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1875546501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb5b185-20b8-43ef-8aff-1618e085fd5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ab89f02a5a49f29e287445ec479aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:50Z,use_quota=True,user_id='3dbe7750b4d0490fac97a6a695a8c7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Creating volume ccb5b185-20b8-43ef-8aff-1618e085fd5f {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:50 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f 1073741824 Sep 28 18:27:50 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:50 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f 1073741824" returned: 0 in 0.497s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f Sep 28 18:27:50 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:50 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f" returned: 0 in 0.290s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810b4293-41e6-4ce6-a8e2-3c1c0575f451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8db7194-cc55-4b58-b02c-3a939a9c7010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:50 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Volume volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f (ccb5b185-20b8-43ef-8aff-1618e085fd5f): created successfully Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8db7194-cc55-4b58-b02c-3a939a9c7010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Flow 'volume_create_manager' (6623ca4a-84fd-4444-a2d1-67517ea71f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:50 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a9ef7207-14b4-4a72-8b8e-e1bdc8b0fd4b tempest-TestImageHashVerification-1535618641 None] Created volume successfully. Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Flow 'volume_create_manager' (e7fcfc02-4639-456b-a966-df394db2606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3774c2b-86af-4a2c-81b9-335ad7bfc105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3774c2b-86af-4a2c-81b9-335ad7bfc105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1507823583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93dae92-dae6-4aa4-8889-0a5681467e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dac32f9168d499ab7516d3979a195bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5efd871-abee-4d4a-9a4a-44dbb494e81b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:53Z,use_quota=True,user_id='485b923a48144be4b0e868426e55d896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a29198-3bba-4436-b424-0e5f2079e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a29198-3bba-4436-b424-0e5f2079e629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9216136-48c5-466f-bcb1-7095f9b8bbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9216136-48c5-466f-bcb1-7095f9b8bbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b93dae92-dae6-4aa4-8889-0a5681467e28', 'volume_name': 'volume-b93dae92-dae6-4aa4-8889-0a5681467e28', 'volume_size': 1, 'snapshot_id': 'c5efd871-abee-4d4a-9a4a-44dbb494e81b'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a48cd47-e8f6-4f47-8b71-d47f2f484524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a48cd47-e8f6-4f47-8b71-d47f2f484524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c5064a-456a-48a5-a641-38497e976052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:52 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Volume b93dae92-dae6-4aa4-8889-0a5681467e28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b93dae92-dae6-4aa4-8889-0a5681467e28', 'volume_size': 1, 'snapshot_id': 'c5efd871-abee-4d4a-9a4a-44dbb494e81b'} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-quobyte-c5efd871-abee-4d4a-9a4a-44dbb494e81b-b93dae92-dae6-4aa4-8889-0a5681467e28" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-c5efd871-abee-4d4a-9a4a-44dbb494e81b-b93dae92-dae6-4aa4-8889-0a5681467e28" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Creating volume b93dae92-dae6-4aa4-8889-0a5681467e28 from snapshot c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-quobyte-b93dae92-dae6-4aa4-8889-0a5681467e28" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-b93dae92-dae6-4aa4-8889-0a5681467e28" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] snapshot: c5efd871-abee-4d4a-9a4a-44dbb494e81b, volume: b93dae92-dae6-4aa4-8889-0a5681467e28, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c66fe2-26d9-4c8d-8e04-8fc789c3d458]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:53 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b Sep 28 18:27:53 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:53 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b" returned: 0 in 0.464s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e59701-6562-4b75-8562-01238877380d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017fdeb-f8dc-4dcb-8b08-324eeab1c74d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d Sep 28 18:27:53 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:53 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d" returned: 0 in 0.394s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:27:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 Sep 28 18:27:53 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:00 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28" returned: 0 in 7.081s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:00 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:28:00 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Converted 1024.00 MB image at 144.60 MB/s Sep 28 18:28:00 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 is being set with open permissions: ugo+rw Sep 28 18:28:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:00 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 Sep 28 18:28:00 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:01 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28" returned: 0 in 0.332s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-b93dae92-dae6-4aa4-8889-0a5681467e28" released by "_copy_volume_from_snapshot" :: held 8.378s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-c5efd871-abee-4d4a-9a4a-44dbb494e81b-b93dae92-dae6-4aa4-8889-0a5681467e28" released by "_create_volume_from_snapshot" :: held 8.497s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.517s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.311s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafd3003-0d7e-4f08-857a-c36500157494]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c5064a-456a-48a5-a641-38497e976052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93dae92-dae6-4aa4-8889-0a5681467e28', 'volume_size': 1, 'snapshot_id': 'c5efd871-abee-4d4a-9a4a-44dbb494e81b'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5348114a-39d4-4b6a-9fb8-616c4bc7fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:01 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Volume volume-b93dae92-dae6-4aa4-8889-0a5681467e28 (b93dae92-dae6-4aa4-8889-0a5681467e28): created successfully Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5348114a-39d4-4b6a-9fb8-616c4bc7fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Flow 'volume_create_manager' (e7fcfc02-4639-456b-a966-df394db2606c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-93fc723d-46ba-4db5-be9b-5ae5708cb442 tempest-TestStampPattern-1938140159 None] Created volume successfully. Sep 28 18:28:01 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f Sep 28 18:28:01 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:01 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f" returned: 0 in 0.513s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[008a0ff5-2a43-403e-af78-58217a34337e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:02 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f Sep 28 18:28:02 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:02 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f" returned: 0 in 0.519s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f /opt/stack/data/cinder/conversion/ccb5b185-20b8-43ef-8aff-1618e085fd5f.temp_image.aa502b05-f386-4f5b-ba8b-738072b39bf3wbyruiu6.img {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:02 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f /opt/stack/data/cinder/conversion/ccb5b185-20b8-43ef-8aff-1618e085fd5f.temp_image.aa502b05-f386-4f5b-ba8b-738072b39bf3wbyruiu6.img Sep 28 18:28:02 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:11 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:11 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:11 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f /opt/stack/data/cinder/conversion/ccb5b185-20b8-43ef-8aff-1618e085fd5f.temp_image.aa502b05-f386-4f5b-ba8b-738072b39bf3wbyruiu6.img" returned: 0 in 9.052s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde3b30-b433-4c51-a9eb-da3b1d671b97]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:11 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f Sep 28 18:28:11 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:12 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f" returned: 0 in 0.577s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:12 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/conversion/ccb5b185-20b8-43ef-8aff-1618e085fd5f.temp_image.aa502b05-f386-4f5b-ba8b-738072b39bf3wbyruiu6.img {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:28:12 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Converted 1024.00 MB image at 113.12 MB/s Sep 28 18:28:12 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] aa502b05-f386-4f5b-ba8b-738072b39bf3 was raw, no need to convert to raw {{(pid=86981) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:28:30 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.331s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:33 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Uploaded volume to glance image-id: aa502b05-f386-4f5b-ba8b-738072b39bf3. {{(pid=86981) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:28:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3136eeb0-bdb7-4d33-9a9a-05409fbfb7e8 tempest-TestImageHashVerification-1535618641 None] Copy volume to image completed successfully. Sep 28 18:28:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Acquiring lock "cinder-ccb5b185-20b8-43ef-8aff-1618e085fd5f-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Lock "cinder-ccb5b185-20b8-43ef-8aff-1618e085fd5f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Acquiring lock "cinder-quobyte-ccb5b185-20b8-43ef-8aff-1618e085fd5f" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Lock "cinder-quobyte-ccb5b185-20b8-43ef-8aff-1618e085fd5f" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:34 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb6f95e-9f14-43b0-aaf3-d94cc7c0288a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:34 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f Sep 28 18:28:34 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:35 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f" returned: 0 in 0.405s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:35 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f Sep 28 18:28:35 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:35 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ccb5b185-20b8-43ef-8aff-1618e085fd5f" returned: 0 in 0.257s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Lock "cinder-quobyte-ccb5b185-20b8-43ef-8aff-1618e085fd5f" released by "delete_volume" :: held 0.701s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Created reservations ['03fe7db7-6c7c-4398-87ff-c553b284b4b0', '94ff4293-955f-4b7f-b353-8be71d137087', '2333fb66-45a2-4973-be26-8db4b262170c', 'f603fee1-d6dc-494c-8ecd-dafe4a5eb70f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:35 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:28:35 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:35 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.267s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Deleted volume successfully. Sep 28 18:28:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b7ca2fd3-366d-4d2b-aeef-c8bf158b2d51 tempest-TestImageHashVerification-1535618641 None] Lock "cinder-ccb5b185-20b8-43ef-8aff-1618e085fd5f-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-0b2e1105-df5f-45d9-b603-2fb11369dda3 req-b4d0def7-6e88-48cf-ad08-050dc73d5b95 tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-0b2e1105-df5f-45d9-b603-2fb11369dda3 req-b4d0def7-6e88-48cf-ad08-050dc73d5b95 tempest-TestStampPattern-1938140159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [req-0b2e1105-df5f-45d9-b603-2fb11369dda3 req-b4d0def7-6e88-48cf-ad08-050dc73d5b95 tempest-TestStampPattern-1938140159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:28:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:28:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:28:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-0b2e1105-df5f-45d9-b603-2fb11369dda3 req-b4d0def7-6e88-48cf-ad08-050dc73d5b95 tempest-TestStampPattern-1938140159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef', 'name': 'volume-b93dae92-dae6-4aa4-8889-0a5681467e28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbbf041e-97f7-47c1-98f9-63aaaa951afd', 'enforce_multipath': True} {{(pid=86981) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:28:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-0b2e1105-df5f-45d9-b603-2fb11369dda3 req-b4d0def7-6e88-48cf-ad08-050dc73d5b95 tempest-TestStampPattern-1938140159 None] attachment_update completed successfully. Sep 28 18:28:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [req-65ed214a-ce1a-42e0-b2db-4b123e402052 req-7f7f6add-8e27-4b2d-a0e7-bc44821ec156 tempest-TestStampPattern-1938140159 None] Terminate volume connection completed successfully. Sep 28 18:28:42 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [req-65ed214a-ce1a-42e0-b2db-4b123e402052 req-7f7f6add-8e27-4b2d-a0e7-bc44821ec156 tempest-TestStampPattern-1938140159 None] Deleting attachment bbbf041e-97f7-47c1-98f9-63aaaa951afd. {{(pid=86981) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:28:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-b93dae92-dae6-4aa4-8889-0a5681467e28-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Lock "cinder-b93dae92-dae6-4aa4-8889-0a5681467e28-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-quobyte-b93dae92-dae6-4aa4-8889-0a5681467e28" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:47 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-b93dae92-dae6-4aa4-8889-0a5681467e28" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:47 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a491ac-1d85-44e5-8f42-965f2bcc77dc]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:47 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 Sep 28 18:28:47 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:48 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28" returned: 0 in 0.481s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:48 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28 Sep 28 18:28:48 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:48 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b93dae92-dae6-4aa4-8889-0a5681467e28" returned: 0 in 0.286s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-b93dae92-dae6-4aa4-8889-0a5681467e28" released by "delete_volume" :: held 0.834s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Created reservations ['524f0263-941d-4a64-9c18-75fe80446fb3', '29f5acb4-1ba8-410d-9bfc-3319b203d65d', '83b713b5-81e0-4fcf-9517-d8deb5a92212', '1dea1401-221f-4ac1-80c0-a7272b75ada9'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:48 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:28:48 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:48 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.335s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:48 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Deleted volume successfully. Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-472bef7a-f9e4-4220-aa0f-8bbe61e33909 tempest-TestStampPattern-1938140159 None] Lock "cinder-b93dae92-dae6-4aa4-8889-0a5681467e28-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-c5efd871-abee-4d4a-9a4a-44dbb494e81b-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Lock "cinder-c5efd871-abee-4d4a-9a4a-44dbb494e81b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-quobyte-17e59701-6562-4b75-8562-01238877380d" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-17e59701-6562-4b75-8562-01238877380d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-quobyte-c5efd871-abee-4d4a-9a4a-44dbb494e81b" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-c5efd871-abee-4d4a-9a4a-44dbb494e81b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Deleting offline snapshot c5efd871-abee-4d4a-9a4a-44dbb494e81b of volume 17e59701-6562-4b75-8562-01238877380d {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] snapshot_file for this snap is: volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11cf128-8414-4bf2-902b-5f9dc22440c3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:49 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b Sep 28 18:28:49 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:49 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b" returned: 0 in 0.393s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e59701-6562-4b75-8562-01238877380d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db9e2b3-90a4-4f90-9a57-c9a51cd1228d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:49 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d Sep 28 18:28:49 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:50 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d" returned: 0 in 0.599s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:50 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b Sep 28 18:28:50 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (b9fd6812-8e81-473b-a09e-1748907bd71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fc89be-d0f2-4d8a-b10e-e60d25f419ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fc89be-d0f2-4d8a-b10e-e60d25f419ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20418922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73459667-4697-42c2-98a6-d9d4acc1852b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:50Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0401b56-7869-4698-bba2-288f09494493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0401b56-7869-4698-bba2-288f09494493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b234a2-698e-4958-8b6e-5eababf8cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b234a2-698e-4958-8b6e-5eababf8cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73459667-4697-42c2-98a6-d9d4acc1852b', 'volume_name': 'volume-73459667-4697-42c2-98a6-d9d4acc1852b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abce93c3-58a7-45b4-8ed1-f3cf416a47c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abce93c3-58a7-45b4-8ed1-f3cf416a47c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b1077d-f3ff-4590-aeae-0e826171b747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:50 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume 73459667-4697-42c2-98a6-d9d4acc1852b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73459667-4697-42c2-98a6-d9d4acc1852b', 'volume_size': 1} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20418922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73459667-4697-42c2-98a6-d9d4acc1852b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:50Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Creating volume 73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:50 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:50 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b 1073741824 Sep 28 18:28:50 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:50 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b" returned: 0 in 0.407s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:50 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b Sep 28 18:28:50 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:50 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b 1073741824" returned: 0 in 0.494s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:50 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d.c5efd871-abee-4d4a-9a4a-44dbb494e81b" returned: 0 in 0.294s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:51 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b Sep 28 18:28:51 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-c5efd871-abee-4d4a-9a4a-44dbb494e81b" released by "_delete_snapshot" :: held 1.848s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-17e59701-6562-4b75-8562-01238877380d" released by "delete_snapshot" :: held 1.879s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Created reservations ['9d29dec4-adc8-495f-9c73-99c31a98a303', 'f9b5e32c-43de-4d7f-9352-abba2403a066', '73494333-d413-48d1-992e-12f6f921bc2e', 'e0794464-7a2b-4e04-b6e7-bd764b8a2c67'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Delete snapshot completed successfully. Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-7ce9b3ca-19b6-49f8-b6aa-b62d9521bc54 tempest-TestStampPattern-1938140159 None] Lock "cinder-c5efd871-abee-4d4a-9a4a-44dbb494e81b-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:51 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b" returned: 0 in 0.286s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b1077d-f3ff-4590-aeae-0e826171b747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73459667-4697-42c2-98a6-d9d4acc1852b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e8562d-ee33-4320-8ad2-0f58175293cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:51 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume volume-73459667-4697-42c2-98a6-d9d4acc1852b (73459667-4697-42c2-98a6-d9d4acc1852b): created successfully Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e8562d-ee33-4320-8ad2-0f58175293cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (b9fd6812-8e81-473b-a09e-1748907bd71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7c435658-0201-439a-affa-e2e51b114769 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created volume successfully. Sep 28 18:28:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Creating offline snapshot 470a1863-3857-4810-8bb6-66b95a2f808a of volume 73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:28:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[670ac0bb-a57f-4268-a090-ecdb0b1e36ce]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:53 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b Sep 28 18:28:53 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:53 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b" returned: 0 in 0.557s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:53 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a 1G Sep 28 18:28:53 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:53 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a 1G" returned: 0 in 0.561s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73459667-4697-42c2-98a6-d9d4acc1852b -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:53 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73459667-4697-42c2-98a6-d9d4acc1852b -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a Sep 28 18:28:53 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:54 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73459667-4697-42c2-98a6-d9d4acc1852b -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a" returned: 0 in 0.394s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:54 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a is being set with open permissions: ugo+rw Sep 28 18:28:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:54 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a Sep 28 18:28:54 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:54 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a" returned: 0 in 0.315s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:54 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.info Sep 28 18:28:54 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:54 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.info" returned: 0 in 0.279s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:54 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.info is being set with open permissions: ugo+rw Sep 28 18:28:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:55 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.info Sep 28 18:28:55 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-17e59701-6562-4b75-8562-01238877380d-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Lock "cinder-17e59701-6562-4b75-8562-01238877380d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Acquiring lock "cinder-quobyte-17e59701-6562-4b75-8562-01238877380d" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-17e59701-6562-4b75-8562-01238877380d" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e090570-af09-47c8-904b-98fe7864219d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:55 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d Sep 28 18:28:55 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:55 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.info" returned: 0 in 0.301s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-89d9aee2-0816-4a6f-bb1f-1528cfd35623 tempest-CreateVolumesFromSnapshotTest-624825843 None] Create snapshot completed successfully Sep 28 18:28:55 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d" returned: 0 in 0.378s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:55 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d Sep 28 18:28:55 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:55 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-17e59701-6562-4b75-8562-01238877380d" returned: 0 in 0.237s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Lock "cinder-quobyte-17e59701-6562-4b75-8562-01238877380d" released by "delete_volume" :: held 0.677s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Created reservations ['1fd43d2f-7eca-4fc4-99e3-3dacb9516593', '0cc34561-0a49-42e5-896d-51bcc0378639', '60eb6f08-477f-4ea8-9989-be2964159a85', '13977704-7dcd-4720-b118-ae50bffc0c61'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:55 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:28:55 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:56 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.308s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Deleted volume successfully. Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f7e76b7d-0b27-470b-94f4-b9e3fa9044ff tempest-TestStampPattern-1938140159 None] Lock "cinder-17e59701-6562-4b75-8562-01238877380d-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (68e2554c-5203-464b-97a7-9b1dc84e820d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c192b049-8925-4a40-a612-079a6aa6fc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c192b049-8925-4a40-a612-079a6aa6fc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1289298622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb788ec0-c176-41c3-906d-f51c18a1cf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:56Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6d6ac-abe9-4713-80be-cfbe951b463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa6d6ac-abe9-4713-80be-cfbe951b463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac976145-456e-48ca-abf5-f6d5848afca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac976145-456e-48ca-abf5-f6d5848afca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb788ec0-c176-41c3-906d-f51c18a1cf92', 'volume_name': 'volume-fb788ec0-c176-41c3-906d-f51c18a1cf92', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07010aa9-a2c0-4d1f-bf55-419a03a9be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07010aa9-a2c0-4d1f-bf55-419a03a9be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4439d152-3386-4d8c-b23b-3d45d0e56673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume fb788ec0-c176-41c3-906d-f51c18a1cf92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb788ec0-c176-41c3-906d-f51c18a1cf92', 'volume_size': 1} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1289298622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb788ec0-c176-41c3-906d-f51c18a1cf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:56Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Creating volume fb788ec0-c176-41c3-906d-f51c18a1cf92 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:56 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:56 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 1073741824 Sep 28 18:28:56 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (759c2b52-c1bc-4028-9581-7540c951093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fb35ce-860c-4613-9f8b-cd632b0511c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fb35ce-860c-4613-9f8b-cd632b0511c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977910375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88df661f-0077-4c58-a9e0-dd38252d1c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:57Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c9b2b1-b7cb-4f13-a4c8-3b17c488ffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c9b2b1-b7cb-4f13-a4c8-3b17c488ffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606b4006-7ab8-46da-b2bf-6a3cb9245b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606b4006-7ab8-46da-b2bf-6a3cb9245b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88df661f-0077-4c58-a9e0-dd38252d1c6e', 'volume_name': 'volume-88df661f-0077-4c58-a9e0-dd38252d1c6e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bfebbd-2d3c-4003-8a89-934447539cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bfebbd-2d3c-4003-8a89-934447539cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47492a42-1316-4a17-be9a-4abad7d936c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume 88df661f-0077-4c58-a9e0-dd38252d1c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88df661f-0077-4c58-a9e0-dd38252d1c6e', 'volume_size': 1} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:57 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 1073741824" returned: 0 in 0.694s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (fa1c5df6-8022-4a6a-806e-81a56b247273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a5c3c8-c4a4-4707-8df1-0ccd5a592117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a5c3c8-c4a4-4707-8df1-0ccd5a592117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747381609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:57Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf480f-2406-4b2a-b0c9-4e20907563ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf480f-2406-4b2a-b0c9-4e20907563ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 Sep 28 18:28:57 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e499607f-2220-49ae-8fc6-4587eb5567de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e499607f-2220-49ae-8fc6-4587eb5567de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad', 'volume_name': 'volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c79644-efef-44d3-9caa-eaaa59f78e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c79644-efef-44d3-9caa-eaaa59f78e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3a7498-8e19-4c8f-a946-28eed718dc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume 2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad', 'volume_size': 1} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:57 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (1ed3f3af-4afa-4a7a-babf-887cb19c3532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876b5ad8-08c1-4e95-afd6-ec2d19affbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92" returned: 0 in 0.491s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977910375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88df661f-0077-4c58-a9e0-dd38252d1c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:57Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Creating volume 88df661f-0077-4c58-a9e0-dd38252d1c6e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:57 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876b5ad8-08c1-4e95-afd6-ec2d19affbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58614211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd7a7cc-8e67-48a4-8f98-82244bbd73eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:58Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7f4307-3be4-484b-9db3-066bbf800531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7f4307-3be4-484b-9db3-066bbf800531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e 1073741824 Sep 28 18:28:57 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1769e5b-0ba9-4c79-aba7-e0286a3e9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1769e5b-0ba9-4c79-aba7-e0286a3e9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd7a7cc-8e67-48a4-8f98-82244bbd73eb', 'volume_name': 'volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b577caca-3f48-40b9-bacb-03ba8370e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b577caca-3f48-40b9-bacb-03ba8370e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ec80a0-16cd-412d-85cc-50ed744e00d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume 0dd7a7cc-8e67-48a4-8f98-82244bbd73eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb', 'volume_size': 1} Sep 28 18:28:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4439d152-3386-4d8c-b23b-3d45d0e56673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb788ec0-c176-41c3-906d-f51c18a1cf92', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edea1c4d-186f-41db-9b92-9fe1bbbf92b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 (fb788ec0-c176-41c3-906d-f51c18a1cf92): created successfully Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edea1c4d-186f-41db-9b92-9fe1bbbf92b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (68e2554c-5203-464b-97a7-9b1dc84e820d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2cbde4a1-0d1b-43f2-9510-f413e8a5d835 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created volume successfully. Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:58 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (386544e3-c748-43ba-a6d8-622b3982b0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c100c90-ac23-4844-bc94-9c122b2a6e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e 1073741824" returned: 0 in 0.624s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c100c90-ac23-4844-bc94-9c122b2a6e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188835545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee6bdc5-6eba-4007-ab0d-c710413dae66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:58Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed63c55c-dc38-4515-bacd-1444a48098cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed63c55c-dc38-4515-bacd-1444a48098cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909bbc4f-9d31-4821-8c9a-e412f390e378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909bbc4f-9d31-4821-8c9a-e412f390e378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee6bdc5-6eba-4007-ab0d-c710413dae66', 'volume_name': 'volume-aee6bdc5-6eba-4007-ab0d-c710413dae66', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5941c7fd-1c35-4664-8bf2-f98d38a93fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5941c7fd-1c35-4664-8bf2-f98d38a93fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8973881-09b4-4982-b0e8-e6f3104ee2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume aee6bdc5-6eba-4007-ab0d-c710413dae66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee6bdc5-6eba-4007-ab0d-c710413dae66', 'volume_size': 1} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:58 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e Sep 28 18:28:58 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:58 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e" returned: 0 in 0.269s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747381609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:57Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Creating volume 2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:58 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47492a42-1316-4a17-be9a-4abad7d936c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88df661f-0077-4c58-a9e0-dd38252d1c6e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad 1073741824 Sep 28 18:28:58 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cdaad3-6d59-4209-bdae-f9a956126948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume volume-88df661f-0077-4c58-a9e0-dd38252d1c6e (88df661f-0077-4c58-a9e0-dd38252d1c6e): created successfully Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cdaad3-6d59-4209-bdae-f9a956126948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (759c2b52-c1bc-4028-9581-7540c951093d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:58 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b0dd0973-43ca-46ba-ac45-7dc3f56b8f00 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created volume successfully. Sep 28 18:28:59 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad 1073741824" returned: 0 in 0.500s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:59 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad Sep 28 18:28:59 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad" returned: 0 in 0.289s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58614211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd7a7cc-8e67-48a4-8f98-82244bbd73eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:58Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Creating volume 0dd7a7cc-8e67-48a4-8f98-82244bbd73eb {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:59 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:59 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb 1073741824 Sep 28 18:28:59 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3a7498-8e19-4c8f-a946-28eed718dc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16596b7e-3bee-476e-8aa2-73265d89bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:59 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad (2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad): created successfully Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16596b7e-3bee-476e-8aa2-73265d89bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (fa1c5df6-8022-4a6a-806e-81a56b247273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:59 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-08acd79d-8d1f-4596-bb60-d5bb4daa7161 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created volume successfully. Sep 28 18:29:00 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb 1073741824" returned: 0 in 0.489s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb Sep 28 18:29:00 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb" returned: 0 in 0.258s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188835545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee6bdc5-6eba-4007-ab0d-c710413dae66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35167542b20b46cda8e4508f16089586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:58Z,use_quota=True,user_id='1c7d7a04aa1045a79714a498cb8fb275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Creating volume aee6bdc5-6eba-4007-ab0d-c710413dae66 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:00 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 1073741824 Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ec80a0-16cd-412d-85cc-50ed744e00d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:00 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79629516-729f-4f85-9470-0b16724ecd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb (0dd7a7cc-8e67-48a4-8f98-82244bbd73eb): created successfully Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79629516-729f-4f85-9470-0b16724ecd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (1ed3f3af-4afa-4a7a-babf-887cb19c3532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-11f808ae-0c64-4312-a524-a04e04f3917a tempest-CreateVolumesFromSnapshotTest-624825843 None] Created volume successfully. Sep 28 18:29:01 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 1073741824" returned: 0 in 0.457s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:01 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 Sep 28 18:29:01 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:01 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66" returned: 0 in 0.252s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8973881-09b4-4982-b0e8-e6f3104ee2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee6bdc5-6eba-4007-ab0d-c710413dae66', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed735097-10cb-47ac-affd-41388e1906d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:01 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Volume volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 (aee6bdc5-6eba-4007-ab0d-c710413dae66): created successfully Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed735097-10cb-47ac-affd-41388e1906d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Flow 'volume_create_manager' (386544e3-c748-43ba-a6d8-622b3982b0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9a3eb307-cabb-4bdd-b8fd-15ec3f57a81d tempest-CreateVolumesFromSnapshotTest-624825843 None] Created volume successfully. Sep 28 18:29:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-aee6bdc5-6eba-4007-ab0d-c710413dae66-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-aee6bdc5-6eba-4007-ab0d-c710413dae66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-aee6bdc5-6eba-4007-ab0d-c710413dae66" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-aee6bdc5-6eba-4007-ab0d-c710413dae66" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edd3ba6-67a8-4677-8586-f9b3ea8612da]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:02 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 Sep 28 18:29:02 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:02 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66" returned: 0 in 0.416s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:02 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66 Sep 28 18:29:02 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:02 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-aee6bdc5-6eba-4007-ab0d-c710413dae66" returned: 0 in 0.273s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-aee6bdc5-6eba-4007-ab0d-c710413dae66" released by "delete_volume" :: held 0.744s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created reservations ['2a83c447-4173-4a16-a2c4-bbf45bef5bfc', '51e490ab-9fbb-4afe-82b9-3aea38102787', 'b142fc3e-769b-49e6-a5a1-88083149d4f4', 'e688d371-a022-4bd0-a9ea-329579898c61'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:02 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:03 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:03 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.328s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Deleted volume successfully. Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-bcbdc680-a394-4397-a612-390c3b8604b3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-aee6bdc5-6eba-4007-ab0d-c710413dae66-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9898b26a-d0a9-408b-9b19-4ebca52ca51c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:03 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb Sep 28 18:29:03 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:03 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb" returned: 0 in 0.426s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:03 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb Sep 28 18:29:03 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:04 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb" returned: 0 in 0.274s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb" released by "delete_volume" :: held 0.750s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created reservations ['e75216ec-fb11-445c-bd90-e63847f6a573', '88702195-6550-432d-8781-138e599c7027', '52056a09-532e-44d2-a657-e1632c4369ba', 'bf176d76-4d5c-44b1-8ee7-2210b55fff73'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:04 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:04 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:04 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.315s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Deleted volume successfully. Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[66944abc-b7c1-452b-a45f-36f68ac96b33]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25486d02-1bd9-4936-b43f-2de4cfe79988 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-0dd7a7cc-8e67-48a4-8f98-82244bbd73eb-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:04 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad Sep 28 18:29:04 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:05 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad" returned: 0 in 0.414s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:05 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad Sep 28 18:29:05 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:05 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad" returned: 0 in 0.302s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad" released by "delete_volume" :: held 0.773s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Created reservations ['b0d73609-3196-4a91-833e-1dfe4c44aee3', '61a01d5f-8dbe-43f7-ade2-d385df131b04', '08ba66da-acea-42a2-a928-2535e6844494', '9b26f4cc-3e92-43aa-9901-15947ff053c1'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:05 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:05 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-88df661f-0077-4c58-a9e0-dd38252d1c6e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-88df661f-0077-4c58-a9e0-dd38252d1c6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:05 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.264s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:05 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Deleted volume successfully. Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-88df661f-0077-4c58-a9e0-dd38252d1c6e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8eeaedd0-5fce-4406-aa16-20e1980316ea tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-2f43a0a0-9dc7-46ec-a8f1-5a0edb6b76ad-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-88df661f-0077-4c58-a9e0-dd38252d1c6e" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ce07ee-4694-4b42-965b-8fd9247eedf0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:05 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e Sep 28 18:29:05 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:06 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e" returned: 0 in 0.461s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:06 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e Sep 28 18:29:06 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:06 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-88df661f-0077-4c58-a9e0-dd38252d1c6e" returned: 0 in 0.291s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-88df661f-0077-4c58-a9e0-dd38252d1c6e" released by "delete_volume" :: held 0.796s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created reservations ['07c625bd-dff1-4630-9210-747c30f4fc6a', '5b2aefe2-a7ca-4834-8a86-8ecbf4b0f348', '0a2f3d56-9c8b-409a-b6ad-df222dbabf7a', 'dc53e267-4788-4361-b627-8a0ecb21ae64'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:06 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:06 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-fb788ec0-c176-41c3-906d-f51c18a1cf92-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-fb788ec0-c176-41c3-906d-f51c18a1cf92-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-fb788ec0-c176-41c3-906d-f51c18a1cf92" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-fb788ec0-c176-41c3-906d-f51c18a1cf92" acquired by "delete_volume" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:06 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.285s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Deleted volume successfully. Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d03cbb-aa1a-4473-ad6e-5786fc043987]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0d0069e6-ab8c-41ee-adbc-6d4f330bb063 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-88df661f-0077-4c58-a9e0-dd38252d1c6e-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:07 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 Sep 28 18:29:07 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:07 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92" returned: 0 in 0.461s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:07 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92 Sep 28 18:29:07 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:07 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-fb788ec0-c176-41c3-906d-f51c18a1cf92" returned: 0 in 0.294s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-fb788ec0-c176-41c3-906d-f51c18a1cf92" released by "delete_volume" :: held 0.815s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created reservations ['6c910b18-9383-4ccd-b563-84eeac063111', '7c3cabc3-d323-4afe-bb83-ad14cec29d5d', '607e7a12-029c-4d10-ba08-a4c93a1531fb', 'f7736247-550c-45c7-9227-8fe86771c355'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:07 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:07 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-470a1863-3857-4810-8bb6-66b95a2f808a-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-470a1863-3857-4810-8bb6-66b95a2f808a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-73459667-4697-42c2-98a6-d9d4acc1852b" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-73459667-4697-42c2-98a6-d9d4acc1852b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-470a1863-3857-4810-8bb6-66b95a2f808a" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-470a1863-3857-4810-8bb6-66b95a2f808a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Deleting offline snapshot 470a1863-3857-4810-8bb6-66b95a2f808a of volume 73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] snapshot_file for this snap is: volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca906f75-215b-46af-b9f2-5cb3e1abf8b1]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:08 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:08 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Deleted volume successfully. Sep 28 18:29:08 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a Sep 28 18:29:08 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-716e615b-31a3-403a-8b6b-808d651090a3 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-fb788ec0-c176-41c3-906d-f51c18a1cf92-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:08 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a" returned: 0 in 0.417s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73459667-4697-42c2-98a6-d9d4acc1852b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d111a8f8-d66a-414e-bb09-62856c87d8bf]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:08 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b Sep 28 18:29:08 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:09 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b" returned: 0 in 0.417s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:09 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a Sep 28 18:29:09 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:09 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a" returned: 0 in 0.375s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:09 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a Sep 28 18:29:09 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:09 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b.470a1863-3857-4810-8bb6-66b95a2f808a" returned: 0 in 0.257s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-470a1863-3857-4810-8bb6-66b95a2f808a" released by "_delete_snapshot" :: held 1.604s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-73459667-4697-42c2-98a6-d9d4acc1852b" released by "delete_snapshot" :: held 1.626s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Created reservations ['a77f99ed-b387-4248-b37f-f2b4803a961c', 'fcc916dd-039f-4e35-a218-3a69c798b2f4', '11efbc0f-d1fb-4ac9-bb68-cf223a39c02c', 'b6abfa44-1b8f-48b4-82f3-8073e9dc9ec1'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Delete snapshot completed successfully. Sep 28 18:29:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a2b8efb-1764-48c3-9181-839c1502950d tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-470a1863-3857-4810-8bb6-66b95a2f808a-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-73459667-4697-42c2-98a6-d9d4acc1852b-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-73459667-4697-42c2-98a6-d9d4acc1852b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "cinder-quobyte-73459667-4697-42c2-98a6-d9d4acc1852b" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-73459667-4697-42c2-98a6-d9d4acc1852b" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c788fb-e478-495f-8a31-ce55caaf82ab]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:10 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b Sep 28 18:29:10 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:10 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b" returned: 0 in 0.387s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:10 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b Sep 28 18:29:10 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:11 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-73459667-4697-42c2-98a6-d9d4acc1852b" returned: 0 in 0.264s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-quobyte-73459667-4697-42c2-98a6-d9d4acc1852b" released by "delete_volume" :: held 0.718s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Created reservations ['87c3bde2-5104-494f-b173-603a895b1d8d', '38291a66-2d58-4ca9-ac19-6bf305aab33c', 'cd121bba-209f-48aa-9512-0bbe34e4f33d', 'cd1fa587-6e12-44fe-ab6f-c40d6ebfcafc'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:11 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:11 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:11 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.262s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Deleted volume successfully. Sep 28 18:29:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-03b85a1a-070e-42e0-8281-fc5a85084264 tempest-CreateVolumesFromSnapshotTest-624825843 None] Lock "cinder-73459667-4697-42c2-98a6-d9d4acc1852b-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Flow 'volume_create_manager' (af61eefb-29da-4e77-afed-498d73a36d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067e8998-38a2-46d8-846b-2d1ae0b1bdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067e8998-38a2-46d8-846b-2d1ae0b1bdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-55993245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fb607a-758d-4a2d-ba45-aa6797ce0e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be66b410f5734ffdb795f5bbd5168e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:14Z,use_quota=True,user_id='d97ed24a67d1405ba88f693a946f861a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b4c173-b99e-49cb-ab5c-9de91c06e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b4c173-b99e-49cb-ab5c-9de91c06e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e3e9d9-cd8f-4982-a92e-1cb669a0751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e3e9d9-cd8f-4982-a92e-1cb669a0751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65fb607a-758d-4a2d-ba45-aa6797ce0e83', 'volume_name': 'volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a441368-78a7-4609-8910-cb36d5a26e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a441368-78a7-4609-8910-cb36d5a26e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15347d1e-c592-41cb-bfd7-db54ff46e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:14 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Volume 65fb607a-758d-4a2d-ba45-aa6797ce0e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83', 'volume_size': 1} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-55993245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fb607a-758d-4a2d-ba45-aa6797ce0e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be66b410f5734ffdb795f5bbd5168e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:14Z,use_quota=True,user_id='d97ed24a67d1405ba88f693a946f861a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Creating volume 65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:14 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:14 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 1073741824 Sep 28 18:29:14 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:14 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 1073741824" returned: 0 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:15 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 Sep 28 18:29:15 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:15 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83" returned: 0 in 0.246s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15347d1e-c592-41cb-bfd7-db54ff46e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8036f054-e3c4-43f3-954a-35440876505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:15 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Volume volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 (65fb607a-758d-4a2d-ba45-aa6797ce0e83): created successfully Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8036f054-e3c4-43f3-954a-35440876505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Flow 'volume_create_manager' (af61eefb-29da-4e77-afed-498d73a36d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3c4f083e-1284-4509-b5bd-1542ceb03d47 tempest-VolumeDependencyTests-1269840671 None] Created volume successfully. Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Creating offline snapshot f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d of volume 65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[451854b1-eaaa-485a-a0e4-082de868df5a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:15 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 Sep 28 18:29:15 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:16 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83" returned: 0 in 0.411s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:16 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d 1G Sep 28 18:29:16 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:16 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d 1G" returned: 0 in 0.513s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:16 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d Sep 28 18:29:16 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:17 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" returned: 0 in 0.330s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:17 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d is being set with open permissions: ugo+rw Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:17 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d Sep 28 18:29:17 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:17 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" returned: 0 in 0.255s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:17 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.info Sep 28 18:29:17 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:17 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.info" returned: 0 in 0.267s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:17 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.info is being set with open permissions: ugo+rw Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:17 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.info Sep 28 18:29:17 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:17 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.info" returned: 0 in 0.269s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8ca5dbac-0e17-4257-92f1-accf0f574c06 tempest-VolumeDependencyTests-1269840671 None] Create snapshot completed successfully Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Flow 'volume_create_manager' (0f0524f0-ed11-4889-9fb2-97fb80a511a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2e003f-e831-4e32-b6f6-70ab3b07e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2e003f-e831-4e32-b6f6-70ab3b07e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1743979701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae46bf07-6bff-446d-ba0d-d14a8d7c3d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be66b410f5734ffdb795f5bbd5168e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:19Z,use_quota=True,user_id='d97ed24a67d1405ba88f693a946f861a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0126df4b-77bd-4a01-bd08-bf80b39043ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0126df4b-77bd-4a01-bd08-bf80b39043ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ee6ac1-5be7-4f5a-a20c-4a557a43f637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ee6ac1-5be7-4f5a-a20c-4a557a43f637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae46bf07-6bff-446d-ba0d-d14a8d7c3d00', 'volume_name': 'volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00', 'volume_size': 1, 'snapshot_id': 'f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cad527-e587-45bb-bf05-11e7b25f58cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cad527-e587-45bb-bf05-11e7b25f58cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e76718-9c76-4da9-8e4b-da50e9c270e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Volume ae46bf07-6bff-446d-ba0d-d14a8d7c3d00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00', 'volume_size': 1, 'snapshot_id': 'f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d'} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-quobyte-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Creating volume ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 from snapshot f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-quobyte-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] snapshot: f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d, volume: ae46bf07-6bff-446d-ba0d-d14a8d7c3d00, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e77f63-b29d-492a-8662-b7b23be5ffa2]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:19 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d Sep 28 18:29:19 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:20 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" returned: 0 in 0.372s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2998051e-4ff7-4d72-9011-c9993d236d84]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:20 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 Sep 28 18:29:20 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:20 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83" returned: 0 in 0.355s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:29:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:20 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 Sep 28 18:29:20 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:26 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" returned: 0 in 5.804s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:29:26 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Converted 1024.00 MB image at 176.40 MB/s Sep 28 18:29:26 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 is being set with open permissions: ugo+rw Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:26 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 Sep 28 18:29:26 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:26 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" returned: 0 in 0.233s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" released by "_copy_volume_from_snapshot" :: held 6.846s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=85,cinder:UPDATE=110,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" released by "_create_volume_from_snapshot" :: held 6.918s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.936s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e76718-9c76-4da9-8e4b-da50e9c270e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00', 'volume_size': 1, 'snapshot_id': 'f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d68ead2-9f4a-4c1e-9916-3ca4a66ef913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Volume volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 (ae46bf07-6bff-446d-ba0d-d14a8d7c3d00): created successfully Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d68ead2-9f4a-4c1e-9916-3ca4a66ef913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Flow 'volume_create_manager' (0f0524f0-ed11-4889-9fb2-97fb80a511a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3043f8f9-5fcc-4249-b5cb-cd91c9237cc3 tempest-VolumeDependencyTests-1269840671 None] Created volume successfully. Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-quobyte-65fb607a-758d-4a2d-ba45-aa6797ce0e83" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-65fb607a-758d-4a2d-ba45-aa6797ce0e83" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-quobyte-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Deleting offline snapshot f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d of volume 65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] snapshot_file for this snap is: volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c674fe2-3546-4901-a88e-7f172fc57af4]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:27 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d Sep 28 18:29:27 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:27 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" returned: 0 in 0.348s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219e583-32f4-4a01-b4b7-a75e9adc0421]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:27 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 Sep 28 18:29:27 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:28 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83" returned: 0 in 0.518s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:28 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d Sep 28 18:29:28 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:28 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" returned: 0 in 0.321s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:28 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d Sep 28 18:29:28 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:28 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83.f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" returned: 0 in 0.237s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d" released by "_delete_snapshot" :: held 1.524s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-65fb607a-758d-4a2d-ba45-aa6797ce0e83" released by "delete_snapshot" :: held 1.546s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Created reservations ['ed4f7560-2758-4bcb-bfb8-cecb9cc50c57', 'fe047ad6-929f-4d01-bd95-9e54611a4fe3', '0bc40067-3a58-4ddd-b36b-e7f3be11f4f6', '14b78dea-446f-47f0-9170-bcd242ea22fe'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Delete snapshot completed successfully. Sep 28 18:29:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d0f584f3-bf37-46ba-87e0-26abd5984be1 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-f73a5f26-8ae4-4fa3-b0ce-85d7e303d74d-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-65fb607a-758d-4a2d-ba45-aa6797ce0e83-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-65fb607a-758d-4a2d-ba45-aa6797ce0e83-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-quobyte-65fb607a-758d-4a2d-ba45-aa6797ce0e83" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-65fb607a-758d-4a2d-ba45-aa6797ce0e83" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b493aeb-84c5-44d7-9f9b-32212b705dae]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 Sep 28 18:29:29 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:29 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83" returned: 0 in 0.372s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83 Sep 28 18:29:29 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-65fb607a-758d-4a2d-ba45-aa6797ce0e83" returned: 0 in 0.254s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-65fb607a-758d-4a2d-ba45-aa6797ce0e83" released by "delete_volume" :: held 0.686s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Created reservations ['4b24a65e-85b0-406b-b60a-2a1af315af9d', 'a1be5047-56f6-4337-9573-59ebec8ed9f0', '1b5194a4-3016-4565-b56e-4bea81a09fde', '0161dab5-3667-45f6-bb71-d07f49db3d6a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:30 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.256s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Deleted volume successfully. Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-80e0453f-038a-4e93-b134-84462524d1d6 tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-65fb607a-758d-4a2d-ba45-aa6797ce0e83-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "cinder-quobyte-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" acquired by "delete_volume" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380ef5a-6f9e-4bfa-8313-2cecc9cbf689]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 Sep 28 18:29:30 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" returned: 0 in 0.350s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:31 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00 Sep 28 18:29:31 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:31 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" returned: 0 in 0.238s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-quobyte-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00" released by "delete_volume" :: held 0.627s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=104,cinder:INSERT=32,cinder:UPDATE=131,cinder:DELETE=13 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Created reservations ['523aa787-66f3-49cc-8ddf-a6f7455af735', '37173c73-1a34-4640-9e10-1b15c94b427d', '51cca6a0-bfca-463d-b004-f3d29a4fd2e0', '20adbfab-d455-4813-aee8-69e43b29fbb0'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:31 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:31 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:31 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.251s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:31 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Deleted volume successfully. Sep 28 18:29:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3b560dcc-52c9-4833-ac40-62f7e48eb06f tempest-VolumeDependencyTests-1269840671 None] Lock "cinder-ae46bf07-6bff-446d-ba0d-d14a8d7c3d00-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Flow 'volume_create_manager' (7bbfbb88-c979-44e6-b411-4de984737443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4087bc18-ae50-4ba8-808b-f91a1c83161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4087bc18-ae50-4ba8-808b-f91a1c83161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5a89b8-8b0b-4454-a38e-3697363cd678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb50a957d164feca9424e3dc41b2781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:34Z,use_quota=True,user_id='92bbe4c9a83944c5b193e55f8bd5781f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d74349-b107-4a97-91bd-493b8610eeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d74349-b107-4a97-91bd-493b8610eeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5832bdb-32ee-4982-9784-4f51d6670e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5832bdb-32ee-4982-9784-4f51d6670e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5a89b8-8b0b-4454-a38e-3697363cd678', 'volume_name': 'volume-6c5a89b8-8b0b-4454-a38e-3697363cd678', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab27cba-a76e-482e-a844-de9385f2683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab27cba-a76e-482e-a844-de9385f2683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7948ffbb-a667-4670-a0b7-8d77a1d2b004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:34 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Volume 6c5a89b8-8b0b-4454-a38e-3697363cd678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5a89b8-8b0b-4454-a38e-3697363cd678', 'volume_size': 1} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5a89b8-8b0b-4454-a38e-3697363cd678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb50a957d164feca9424e3dc41b2781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:34Z,use_quota=True,user_id='92bbe4c9a83944c5b193e55f8bd5781f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Creating volume 6c5a89b8-8b0b-4454-a38e-3697363cd678 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:34 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:29:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:34 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 1073741824 Sep 28 18:29:34 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:35 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 1073741824" returned: 0 in 0.470s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:35 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 Sep 28 18:29:35 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:35 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678" returned: 0 in 0.246s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7948ffbb-a667-4670-a0b7-8d77a1d2b004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5a89b8-8b0b-4454-a38e-3697363cd678', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2656fa00-d532-4d34-861a-391fed597fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:35 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Volume volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 (6c5a89b8-8b0b-4454-a38e-3697363cd678): created successfully Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2656fa00-d532-4d34-861a-391fed597fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:35 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Flow 'volume_create_manager' (7bbfbb88-c979-44e6-b411-4de984737443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ef0b466e-df21-464e-b1f2-19f1e45217e2 tempest-CinderUnicodeTest-496593496 None] Created volume successfully. Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Flow 'volume_create_manager' (cff1b715-0197-4e03-aea6-f7f531cde664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e314cc22-b5db-4a22-ace8-f0725a44aefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e314cc22-b5db-4a22-ace8-f0725a44aefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1464320730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a7b820-6f82-496f-93ae-70073b622958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb50a957d164feca9424e3dc41b2781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:36Z,use_quota=True,user_id='92bbe4c9a83944c5b193e55f8bd5781f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6138b05e-5f8f-427e-90ec-3ad4de399e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6138b05e-5f8f-427e-90ec-3ad4de399e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb42d10-b5a8-41af-adf0-ede8b9311de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb42d10-b5a8-41af-adf0-ede8b9311de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a7b820-6f82-496f-93ae-70073b622958', 'volume_name': 'volume-53a7b820-6f82-496f-93ae-70073b622958', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f125e57-c82e-4013-8ef6-102a0ea6227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f125e57-c82e-4013-8ef6-102a0ea6227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e31b04d-151e-400e-a030-4a8b558cade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Volume 53a7b820-6f82-496f-93ae-70073b622958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a7b820-6f82-496f-93ae-70073b622958', 'volume_size': 1} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1464320730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a7b820-6f82-496f-93ae-70073b622958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb50a957d164feca9424e3dc41b2781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:36Z,use_quota=True,user_id='92bbe4c9a83944c5b193e55f8bd5781f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Creating volume 53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:36 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:36 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 1073741824 Sep 28 18:29:36 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:36 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 1073741824" returned: 0 in 0.407s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:36 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 Sep 28 18:29:36 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:36 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958" returned: 0 in 0.245s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e31b04d-151e-400e-a030-4a8b558cade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a7b820-6f82-496f-93ae-70073b622958', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0ced2-e1c4-4031-a706-7dc790e924cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Volume volume-53a7b820-6f82-496f-93ae-70073b622958 (53a7b820-6f82-496f-93ae-70073b622958): created successfully Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0ced2-e1c4-4031-a706-7dc790e924cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Flow 'volume_create_manager' (cff1b715-0197-4e03-aea6-f7f531cde664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:36 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2afacbd9-fdc4-45bf-abc4-0fa8e75ef523 tempest-CinderUnicodeTest-496593496 None] Created volume successfully. Sep 28 18:29:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Creating offline snapshot 6428882a-82ac-4d55-af57-cb66d500aa8d of volume 53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:37 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa060fc-05e6-43a4-b97e-7c56bd3a70b7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:37 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 Sep 28 18:29:37 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:37 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958" returned: 0 in 0.348s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:37 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d 1G Sep 28 18:29:37 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d 1G" returned: 0 in 0.399s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53a7b820-6f82-496f-93ae-70073b622958 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53a7b820-6f82-496f-93ae-70073b622958 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d Sep 28 18:29:38 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53a7b820-6f82-496f-93ae-70073b622958 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d" returned: 0 in 0.287s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:38 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d is being set with open permissions: ugo+rw Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d Sep 28 18:29:38 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d" returned: 0 in 0.249s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.info Sep 28 18:29:38 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:38 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.info" returned: 0 in 0.244s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:38 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.info is being set with open permissions: ugo+rw Sep 28 18:29:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.info Sep 28 18:29:38 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:39 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.240s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:29:39 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.info" returned: 0 in 0.260s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:39 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8ac05ccf-e3b7-4f90-bac1-f553d3a2a58d tempest-CinderUnicodeTest-496593496 None] Create snapshot completed successfully Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Acquiring lock "cinder-6428882a-82ac-4d55-af57-cb66d500aa8d-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Lock "cinder-6428882a-82ac-4d55-af57-cb66d500aa8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Acquiring lock "cinder-quobyte-53a7b820-6f82-496f-93ae-70073b622958" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-53a7b820-6f82-496f-93ae-70073b622958" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Acquiring lock "cinder-quobyte-6428882a-82ac-4d55-af57-cb66d500aa8d" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-6428882a-82ac-4d55-af57-cb66d500aa8d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Deleting offline snapshot 6428882a-82ac-4d55-af57-cb66d500aa8d of volume 53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] snapshot_file for this snap is: volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc32fa77-73e6-46a8-b4fc-23ef8e5ca446]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:39 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d Sep 28 18:29:39 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:39 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d" returned: 0 in 0.351s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53a7b820-6f82-496f-93ae-70073b622958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[238353c4-9e4a-47e0-b482-9dc4b7f0cb99]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:39 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 Sep 28 18:29:39 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:40 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958" returned: 0 in 0.350s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:40 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d Sep 28 18:29:40 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:40 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d" returned: 0 in 0.314s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:40 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d Sep 28 18:29:40 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:40 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958.6428882a-82ac-4d55-af57-cb66d500aa8d" returned: 0 in 0.241s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-6428882a-82ac-4d55-af57-cb66d500aa8d" released by "_delete_snapshot" :: held 1.356s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-53a7b820-6f82-496f-93ae-70073b622958" released by "delete_snapshot" :: held 1.379s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Created reservations ['f6d2ae51-6fa6-434a-89dd-f50cea30d710', 'eb6b43f1-2200-40b6-a364-eb7a69f544ee', 'a8289e5e-e052-4a69-bcca-ae3399d71aa5', '4eae4f7d-6d79-4e7a-a2a7-f6fb391cbe09'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Delete snapshot completed successfully. Sep 28 18:29:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-25251aee-b096-47dc-be17-7662bdd3880d tempest-CinderUnicodeTest-496593496 None] Lock "cinder-6428882a-82ac-4d55-af57-cb66d500aa8d-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "cinder-53a7b820-6f82-496f-93ae-70073b622958-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-53a7b820-6f82-496f-93ae-70073b622958-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "cinder-quobyte-53a7b820-6f82-496f-93ae-70073b622958" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-53a7b820-6f82-496f-93ae-70073b622958" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1040dd1-87c8-45e4-a07e-43cf5ac2fad0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:41 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 Sep 28 18:29:41 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958" returned: 0 in 0.414s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958 Sep 28 18:29:42 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-53a7b820-6f82-496f-93ae-70073b622958" returned: 0 in 0.247s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-53a7b820-6f82-496f-93ae-70073b622958" released by "delete_volume" :: held 0.742s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Created reservations ['5ec56211-e813-46ec-8aaf-dc51228cc574', '81361714-63b9-4d79-bd52-7bb51f276eb5', '25e6ad28-7927-4837-aa3c-0ab48519047f', '51a271f8-8c67-4d97-8789-59cc002f9e5f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:42 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "cinder-6c5a89b8-8b0b-4454-a38e-3697363cd678-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-6c5a89b8-8b0b-4454-a38e-3697363cd678-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "cinder-quobyte-6c5a89b8-8b0b-4454-a38e-3697363cd678" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:42 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.292s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-6c5a89b8-8b0b-4454-a38e-3697363cd678" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Deleted volume successfully. Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b72a3f-009b-455c-a1cc-195b045f626e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ce6e14fd-fb6e-40fb-a550-f6f2a54c3fd2 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-53a7b820-6f82-496f-93ae-70073b622958-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:43 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 Sep 28 18:29:43 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:43 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678" returned: 0 in 0.380s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:43 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678 Sep 28 18:29:43 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:43 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6c5a89b8-8b0b-4454-a38e-3697363cd678" returned: 0 in 0.257s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-quobyte-6c5a89b8-8b0b-4454-a38e-3697363cd678" released by "delete_volume" :: held 0.691s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Created reservations ['c25829d2-0246-494f-816b-e6f52c4d546a', '15c10498-bc63-4871-b466-283a6273e723', 'ecb116ea-2211-4352-8ba2-860034192b02', '52154ce4-5146-48aa-9313-2c2ecb5fb12e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:43 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:43 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:43 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.262s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Deleted volume successfully. Sep 28 18:29:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a4235de1-b0db-41e4-be9d-dfd71be366d3 tempest-CinderUnicodeTest-496593496 None] Lock "cinder-6c5a89b8-8b0b-4454-a38e-3697363cd678-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Flow 'volume_create_manager' (6d4e7b8c-5ef8-436a-97d9-ef1e723dbf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a6ee13-db01-42a2-ab23-5cb3bd4d2d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a6ee13-db01-42a2-ab23-5cb3bd4d2d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286342709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e988e8f4-4d4a-4add-ba43-af49a2575033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d3a200550248bd979e294d6753151e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:48Z,use_quota=True,user_id='93c6b702411d49ffafa0e7b5c9d61870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb0ed7-1180-4f48-8c78-a938777516c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb0ed7-1180-4f48-8c78-a938777516c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a29bf6-bdb8-4cec-a6c2-c45b103b8971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a29bf6-bdb8-4cec-a6c2-c45b103b8971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e988e8f4-4d4a-4add-ba43-af49a2575033', 'volume_name': 'volume-e988e8f4-4d4a-4add-ba43-af49a2575033', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259c7a51-6624-484a-99bd-2a2707fc37f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259c7a51-6624-484a-99bd-2a2707fc37f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d72c9a-9334-446b-aeb4-136884cd6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:47 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Volume e988e8f4-4d4a-4add-ba43-af49a2575033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e988e8f4-4d4a-4add-ba43-af49a2575033', 'volume_size': 1} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286342709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e988e8f4-4d4a-4add-ba43-af49a2575033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d3a200550248bd979e294d6753151e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:48Z,use_quota=True,user_id='93c6b702411d49ffafa0e7b5c9d61870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Creating volume e988e8f4-4d4a-4add-ba43-af49a2575033 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:47 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:29:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:47 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 1073741824 Sep 28 18:29:47 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:48 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 1073741824" returned: 0 in 0.463s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:48 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 Sep 28 18:29:48 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:48 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033" returned: 0 in 0.254s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d72c9a-9334-446b-aeb4-136884cd6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e988e8f4-4d4a-4add-ba43-af49a2575033', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6c093b-a055-4adf-85c2-0a8f68cf6926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:48 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Volume volume-e988e8f4-4d4a-4add-ba43-af49a2575033 (e988e8f4-4d4a-4add-ba43-af49a2575033): created successfully Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6c093b-a055-4adf-85c2-0a8f68cf6926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Flow 'volume_create_manager' (6d4e7b8c-5ef8-436a-97d9-ef1e723dbf2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-11956ece-e667-46b4-9c9e-876c7ad6d912 tempest-ProjectReaderTests-978981776 None] Created volume successfully. Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Acquiring lock "cinder-e988e8f4-4d4a-4add-ba43-af49a2575033-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Lock "cinder-e988e8f4-4d4a-4add-ba43-af49a2575033-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Acquiring lock "cinder-quobyte-e988e8f4-4d4a-4add-ba43-af49a2575033" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Lock "cinder-quobyte-e988e8f4-4d4a-4add-ba43-af49a2575033" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c2570d-73d5-41af-ba96-833c17b1d60e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:50 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 Sep 28 18:29:50 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:50 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033" returned: 0 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:50 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033 Sep 28 18:29:50 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:50 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e988e8f4-4d4a-4add-ba43-af49a2575033" returned: 0 in 0.268s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Lock "cinder-quobyte-e988e8f4-4d4a-4add-ba43-af49a2575033" released by "delete_volume" :: held 0.740s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Created reservations ['2c0e7b7b-8023-4913-86ea-70066a8aa799', 'a22de962-c5e5-469f-825c-f632dbcd6542', '51504a0c-62fb-44d7-a758-f27221993386', '60aa575f-e740-4304-a6a2-bee55c3ae2e0'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:50 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:51 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:51 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.261s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Deleted volume successfully. Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-448714a9-43c3-49c6-942f-ad888ec97b79 tempest-ProjectReaderTests-978981776 None] Lock "cinder-e988e8f4-4d4a-4add-ba43-af49a2575033-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Flow 'volume_create_manager' (15ac3db9-d7ed-446d-b647-4fb2ceab15bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a89f9e-0d6b-4f18-ad37-b71950b49cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a89f9e-0d6b-4f18-ad37-b71950b49cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1981245939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da24374-adde-4f86-abd0-22d58eecc1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d3a200550248bd979e294d6753151e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:52Z,use_quota=True,user_id='93c6b702411d49ffafa0e7b5c9d61870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c859ab-ef92-45d0-83c0-10cd84802d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c859ab-ef92-45d0-83c0-10cd84802d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b98a18-6947-4fd5-9589-b2b1dc6c63ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b98a18-6947-4fd5-9589-b2b1dc6c63ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da24374-adde-4f86-abd0-22d58eecc1f8', 'volume_name': 'volume-0da24374-adde-4f86-abd0-22d58eecc1f8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64feec17-b65f-4f57-b9e2-1c3d907d4da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64feec17-b65f-4f57-b9e2-1c3d907d4da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6abeb8e-2a17-4676-976a-b8c410fbd438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:51 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Volume 0da24374-adde-4f86-abd0-22d58eecc1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da24374-adde-4f86-abd0-22d58eecc1f8', 'volume_size': 1} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1981245939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da24374-adde-4f86-abd0-22d58eecc1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d3a200550248bd979e294d6753151e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:52Z,use_quota=True,user_id='93c6b702411d49ffafa0e7b5c9d61870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Creating volume 0da24374-adde-4f86-abd0-22d58eecc1f8 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:51 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:29:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:51 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 1073741824 Sep 28 18:29:51 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:52 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 1073741824" returned: 0 in 0.455s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:52 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 Sep 28 18:29:52 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:52 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8" returned: 0 in 0.260s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6abeb8e-2a17-4676-976a-b8c410fbd438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da24374-adde-4f86-abd0-22d58eecc1f8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c1b36f-4c05-425f-ad54-41ca9bc3952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Volume volume-0da24374-adde-4f86-abd0-22d58eecc1f8 (0da24374-adde-4f86-abd0-22d58eecc1f8): created successfully Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c1b36f-4c05-425f-ad54-41ca9bc3952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Flow 'volume_create_manager' (15ac3db9-d7ed-446d-b647-4fb2ceab15bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-23121955-f798-4744-8834-53e44a38425c tempest-ProjectReaderTests-978981776 None] Created volume successfully. Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Acquiring lock "cinder-0da24374-adde-4f86-abd0-22d58eecc1f8-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Lock "cinder-0da24374-adde-4f86-abd0-22d58eecc1f8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Acquiring lock "cinder-quobyte-0da24374-adde-4f86-abd0-22d58eecc1f8" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Lock "cinder-quobyte-0da24374-adde-4f86-abd0-22d58eecc1f8" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcbb4b0-9abb-4d9c-9880-097631a3475e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:52 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 Sep 28 18:29:52 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:53 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8" returned: 0 in 0.377s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:53 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8 Sep 28 18:29:53 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:53 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-0da24374-adde-4f86-abd0-22d58eecc1f8" returned: 0 in 0.252s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Lock "cinder-quobyte-0da24374-adde-4f86-abd0-22d58eecc1f8" released by "delete_volume" :: held 0.675s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Created reservations ['7383f731-b0da-4fc9-8910-48a3dcde386a', '435ef7b8-6d29-4e08-b8c2-d07272eaaaa4', '81bc7f5f-d45a-4985-bd35-cf1bfb47ecc2', '61479267-b527-42c9-9e37-10333dcfca78'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:53 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:29:53 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:53 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.264s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Deleted volume successfully. Sep 28 18:29:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b2ba274a-7b4d-4922-86d9-c7031dd89abb tempest-ProjectReaderTests-978981776 None] Lock "cinder-0da24374-adde-4f86-abd0-22d58eecc1f8-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:03 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:INSERT=15,cinder:UPDATE=63,cinder:SELECT=35,cinder:DELETE=3 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:30:03 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=65,cinder:SELECT=58,cinder:INSERT=19,cinder:DELETE=7 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (5e175773-6a2d-42b9-b068-7d92edfab6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d55ea23-67f3-4246-9f15-8560d74a046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d55ea23-67f3-4246-9f15-8560d74a046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328969994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e92c3ad-9331-4b2a-91e1-132f95ddbc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:07Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28630200-86d1-4fd2-9512-273a6f0d5760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28630200-86d1-4fd2-9512-273a6f0d5760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3922db69-e432-4416-8b47-12971118329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3922db69-e432-4416-8b47-12971118329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e92c3ad-9331-4b2a-91e1-132f95ddbc6a', 'volume_name': 'volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91015fd-37bd-435c-86a4-c9147d8be64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91015fd-37bd-435c-86a4-c9147d8be64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bee1df0-569e-46da-90a0-8614e6bd3495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume 9e92c3ad-9331-4b2a-91e1-132f95ddbc6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a', 'volume_size': 1} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328969994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e92c3ad-9331-4b2a-91e1-132f95ddbc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:07Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Creating volume 9e92c3ad-9331-4b2a-91e1-132f95ddbc6a {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:07 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:07 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a 1073741824 Sep 28 18:30:07 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (87d4a371-1d53-4f7c-9aee-b47470682a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56f578a-43f3-4666-b3ca-fa66e3692920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56f578a-43f3-4666-b3ca-fa66e3692920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013212368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd910c9-066e-4101-afe7-68a3fc1e012b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:07Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e344cdf-aee1-4a9c-87c0-45cf8b452940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e344cdf-aee1-4a9c-87c0-45cf8b452940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2d9e3f-1bc8-4594-b660-c3c113ce060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2d9e3f-1bc8-4594-b660-c3c113ce060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd910c9-066e-4101-afe7-68a3fc1e012b', 'volume_name': 'volume-3fd910c9-066e-4101-afe7-68a3fc1e012b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0088c1-f1bc-43e2-97f0-7e6d982ae87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0088c1-f1bc-43e2-97f0-7e6d982ae87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed83b59-d8df-4187-b4e9-d88004c29b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:07 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Volume 3fd910c9-066e-4101-afe7-68a3fc1e012b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd910c9-066e-4101-afe7-68a3fc1e012b', 'volume_size': 1} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:07 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a 1073741824" returned: 0 in 0.618s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:07 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a Sep 28 18:30:07 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:07 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (a8d150b5-be14-44b9-b152-1c3efe31c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e64c607-6916-48be-a8c3-35bc792a1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e64c607-6916-48be-a8c3-35bc792a1a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1616248018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08295d9-0b01-4592-a4d3-b9f740800dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:08Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67bd9cf-7ad3-4126-8138-739dbb195050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67bd9cf-7ad3-4126-8138-739dbb195050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31b93e0-e7f7-41fa-adea-13cbb38f7e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31b93e0-e7f7-41fa-adea-13cbb38f7e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08295d9-0b01-4592-a4d3-b9f740800dc5', 'volume_name': 'volume-f08295d9-0b01-4592-a4d3-b9f740800dc5', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb7051f-a515-475a-ae65-e6ca3c106477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb7051f-a515-475a-ae65-e6ca3c106477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a56e87-a8bd-41a2-bc39-d3fd79874386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Volume f08295d9-0b01-4592-a4d3-b9f740800dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08295d9-0b01-4592-a4d3-b9f740800dc5', 'volume_size': 1} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:08 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a" returned: 0 in 0.374s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013212368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd910c9-066e-4101-afe7-68a3fc1e012b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:07Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Creating volume 3fd910c9-066e-4101-afe7-68a3fc1e012b {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:08 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bee1df0-569e-46da-90a0-8614e6bd3495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b663fbae-a1b6-4f2e-bd61-fc39db201d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b 1073741824 Sep 28 18:30:08 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:08 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a (9e92c3ad-9331-4b2a-91e1-132f95ddbc6a): created successfully Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b663fbae-a1b6-4f2e-bd61-fc39db201d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (5e175773-6a2d-42b9-b068-7d92edfab6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (0fd11fe7-4db2-4bf1-a8ce-a2cd55d56ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e175f8-e8f5-4176-bd1f-b53bf7a06272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0528fb47-1da3-4c00-9375-47ca7278d58e tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created volume successfully. Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e175f8-e8f5-4176-bd1f-b53bf7a06272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1963371735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3913d1c7-a620-4c84-b244-40346d17772d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:08Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beed2f77-faca-4612-b866-53ecf485b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beed2f77-faca-4612-b866-53ecf485b541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dd7560-a785-43af-8984-9b8a11ce3672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dd7560-a785-43af-8984-9b8a11ce3672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3913d1c7-a620-4c84-b244-40346d17772d', 'volume_name': 'volume-3913d1c7-a620-4c84-b244-40346d17772d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb31829b-6261-492e-94a1-cea11c011b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb31829b-6261-492e-94a1-cea11c011b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a37cf2-fa2b-4bce-bdb3-00427ab967ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume 3913d1c7-a620-4c84-b244-40346d17772d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3913d1c7-a620-4c84-b244-40346d17772d', 'volume_size': 1} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (d8b1dcbc-2416-4abf-8d0c-84a1310ecc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a0a005-99f7-48c2-8d43-e919ede7244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a0a005-99f7-48c2-8d43-e919ede7244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100759830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f941e252-2d96-437e-a582-e542975c9d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:09Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa506ec-0b0e-4d33-a262-39132f32f9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa506ec-0b0e-4d33-a262-39132f32f9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52adac19-0a25-430a-b5e1-e145ea8fc670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52adac19-0a25-430a-b5e1-e145ea8fc670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f941e252-2d96-437e-a582-e542975c9d41', 'volume_name': 'volume-f941e252-2d96-437e-a582-e542975c9d41', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c92123b-94d8-49dd-9e16-257199437d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c92123b-94d8-49dd-9e16-257199437d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f3890a-6d1a-4333-a58a-8d6e8bfbe143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:08 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Volume f941e252-2d96-437e-a582-e542975c9d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f941e252-2d96-437e-a582-e542975c9d41', 'volume_size': 1} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:08 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b 1073741824" returned: 0 in 0.669s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:09 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b Sep 28 18:30:09 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:09 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1616248018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08295d9-0b01-4592-a4d3-b9f740800dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:08Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Creating volume f08295d9-0b01-4592-a4d3-b9f740800dc5 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:09 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed83b59-d8df-4187-b4e9-d88004c29b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd910c9-066e-4101-afe7-68a3fc1e012b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:09 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 1073741824 Sep 28 18:30:09 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9497f0-5a71-46e1-964a-a628fbe1ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:09 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Volume volume-3fd910c9-066e-4101-afe7-68a3fc1e012b (3fd910c9-066e-4101-afe7-68a3fc1e012b): created successfully Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9497f0-5a71-46e1-964a-a628fbe1ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (87d4a371-1d53-4f7c-9aee-b47470682a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-80c9f547-3177-4dd9-8199-b2465d10cb3d tempest-CreateVolumesFromImageTest-676001363 None] Created volume successfully. Sep 28 18:30:09 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (3d3267d3-e435-4b2d-9122-2cf14a79f7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa69ee4e-717f-41c4-8c6e-769790149039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa69ee4e-717f-41c4-8c6e-769790149039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-872539206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a96bfa-84f2-42d1-aa56-21a7fd4f9097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:10Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c164e34-7ee9-432b-b7f0-292bc674c54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c164e34-7ee9-432b-b7f0-292bc674c54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90004f0b-72f2-454b-9f71-a9d1409597cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90004f0b-72f2-454b-9f71-a9d1409597cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a96bfa-84f2-42d1-aa56-21a7fd4f9097', 'volume_name': 'volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c603753-f7c1-4361-83fa-a82f8a462d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c603753-f7c1-4361-83fa-a82f8a462d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4b77f1-a9d3-42bf-b9f3-62144e48d0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Volume b2a96bfa-84f2-42d1-aa56-21a7fd4f9097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097', 'volume_size': 1} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 1073741824" returned: 0 in 0.882s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (d51fd1be-ab1e-44b2-866a-ff6c7ec31241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f943e986-3cc2-4645-a9e8-820d2df9cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f943e986-3cc2-4645-a9e8-820d2df9cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820629602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f17a65-0d9e-4d60-bbf6-128e601d3aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:10Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f165241-4946-4133-9516-977d11204c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f165241-4946-4133-9516-977d11204c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901fdc71-16ca-4a4f-aa84-997f49476ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901fdc71-16ca-4a4f-aa84-997f49476ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f17a65-0d9e-4d60-bbf6-128e601d3aa7', 'volume_name': 'volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f187601-bbff-41d2-a7c9-cad1dc6980a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f187601-bbff-41d2-a7c9-cad1dc6980a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22b009f-a5cd-4b5e-a6d8-55d3695be779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume c6f17a65-0d9e-4d60-bbf6-128e601d3aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7', 'volume_size': 1} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:10 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 Sep 28 18:30:10 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:10 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (ddf2542e-ad96-429c-852a-13acae87aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecf0f69-188a-4652-8f95-366fbfa70dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5" returned: 0 in 0.557s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.421s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1963371735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3913d1c7-a620-4c84-b244-40346d17772d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:08Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Creating volume 3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:10 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecf0f69-188a-4652-8f95-366fbfa70dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010218967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e49062-da5b-4efa-993d-c0d20cbcb63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:11Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33dad99-2830-4719-919e-8fa80dc6d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d 1073741824 Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33dad99-2830-4719-919e-8fa80dc6d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a6a9e8-fcba-492b-baf8-f18ad5bf1d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a6a9e8-fcba-492b-baf8-f18ad5bf1d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e49062-da5b-4efa-993d-c0d20cbcb63e', 'volume_name': 'volume-87e49062-da5b-4efa-993d-c0d20cbcb63e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe86fe25-8b45-4a5f-bfa9-5a3adca08ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe86fe25-8b45-4a5f-bfa9-5a3adca08ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a335b9-7e2b-4e0d-b89e-9ca4d4a80db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Volume 87e49062-da5b-4efa-993d-c0d20cbcb63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e49062-da5b-4efa-993d-c0d20cbcb63e', 'volume_size': 1} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (1cbac634-a109-4c6b-b5ac-0b2e802eb92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b499dcb0-7155-4dcd-8ab5-3d80a476ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a56e87-a8bd-41a2-bc39-d3fd79874386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08295d9-0b01-4592-a4d3-b9f740800dc5', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ad4dd-b4b8-4f53-89fa-a8d27644d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b499dcb0-7155-4dcd-8ab5-3d80a476ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282441274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646aee85-0394-44e6-a1cf-ed0577bec8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:11Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9863990-bfd6-46f1-ae0b-49a32e37f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9863990-bfd6-46f1-ae0b-49a32e37f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f19dad-eb22-4975-b940-2e3359e3113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f19dad-eb22-4975-b940-2e3359e3113a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646aee85-0394-44e6-a1cf-ed0577bec8b7', 'volume_name': 'volume-646aee85-0394-44e6-a1cf-ed0577bec8b7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cf1094-f55b-45a9-90ea-4fa430d76c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cf1094-f55b-45a9-90ea-4fa430d76c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6808ccca-72a3-4497-bb14-a2ac9173b446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume 646aee85-0394-44e6-a1cf-ed0577bec8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646aee85-0394-44e6-a1cf-ed0577bec8b7', 'volume_size': 1} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Volume volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 (f08295d9-0b01-4592-a4d3-b9f740800dc5): created successfully Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7ad4dd-b4b8-4f53-89fa-a8d27644d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (a8d150b5-be14-44b9-b152-1c3efe31c136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c2e2c28f-099f-4778-836d-8bef1a7018fb tempest-CreateVolumesFromImageTest-676001363 None] Created volume successfully. Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (f786d179-d0ce-4a62-a18e-39cdfd960bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be3a63a-6c1d-4b1e-9765-3b7022e2470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be3a63a-6c1d-4b1e-9765-3b7022e2470b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-617810827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63130665-4280-44a5-9869-2e3b80e7db95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:11Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159e3302-7571-421e-aea2-650e011bf88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159e3302-7571-421e-aea2-650e011bf88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faff2e5-ed81-4238-8793-e59b91e64850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faff2e5-ed81-4238-8793-e59b91e64850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63130665-4280-44a5-9869-2e3b80e7db95', 'volume_name': 'volume-63130665-4280-44a5-9869-2e3b80e7db95', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9bde03-d8ed-4795-95d2-cdb04c224a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9bde03-d8ed-4795-95d2-cdb04c224a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45bc0c80-1bca-4961-8e23-e270ed3a8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume 63130665-4280-44a5-9869-2e3b80e7db95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63130665-4280-44a5-9869-2e3b80e7db95', 'volume_size': 1} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:11 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d 1073741824" returned: 0 in 0.778s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (8c399a99-d337-4af1-bfb6-27d1de05528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f260d0-f96d-4199-9a95-6dfb572a8732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f260d0-f96d-4199-9a95-6dfb572a8732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943633404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bf2720-a89b-4dd7-9fee-ee97f362818e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:12Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55cf4ff-c8e2-425f-aaed-c707d7cc64b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55cf4ff-c8e2-425f-aaed-c707d7cc64b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb408192-d6d7-4039-a571-2a9b251b2358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb408192-d6d7-4039-a571-2a9b251b2358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9bf2720-a89b-4dd7-9fee-ee97f362818e', 'volume_name': 'volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b75638-22e7-41df-be46-498773d9a9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b75638-22e7-41df-be46-498773d9a9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563f1bb0-4233-45d2-8bc7-c409cc59008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume e9bf2720-a89b-4dd7-9fee-ee97f362818e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e', 'volume_size': 1} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:11 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d Sep 28 18:30:11 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:12 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (592e4e9c-9b0e-40fc-bdc3-9786ffb9ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de78731-e1f3-4cfa-87b0-ee12156101f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d" returned: 0 in 0.363s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.399s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100759830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f941e252-2d96-437e-a582-e542975c9d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:09Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Creating volume f941e252-2d96-437e-a582-e542975c9d41 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:12 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de78731-e1f3-4cfa-87b0-ee12156101f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197067355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80065ec-d270-4e27-9826-8177141f4ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:12Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bc3155-29fb-4b31-9db0-88f49db57995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:12 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 1073741824 Sep 28 18:30:12 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bc3155-29fb-4b31-9db0-88f49db57995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884d7516-de41-4533-abe4-351097a03a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884d7516-de41-4533-abe4-351097a03a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80065ec-d270-4e27-9826-8177141f4ad7', 'volume_name': 'volume-e80065ec-d270-4e27-9826-8177141f4ad7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e9fb04-bda2-493d-9cb9-39c460fa41bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e9fb04-bda2-493d-9cb9-39c460fa41bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f80d8b6-4b79-4c19-9a00-db690397dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:12 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume e80065ec-d270-4e27-9826-8177141f4ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80065ec-d270-4e27-9826-8177141f4ad7', 'volume_size': 1} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a37cf2-fa2b-4bce-bdb3-00427ab967ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3913d1c7-a620-4c84-b244-40346d17772d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b61b94-e65b-47fc-834e-62165fc0fc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:12 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume volume-3913d1c7-a620-4c84-b244-40346d17772d (3913d1c7-a620-4c84-b244-40346d17772d): created successfully Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b61b94-e65b-47fc-834e-62165fc0fc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (0fd11fe7-4db2-4bf1-a8ce-a2cd55d56ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:12 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-85627df6-6296-4e5f-a75f-c22ced7e1dc3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created volume successfully. Sep 28 18:30:12 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 1073741824" returned: 0 in 0.555s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:12 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 Sep 28 18:30:12 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:13 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41" returned: 0 in 0.357s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.099s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-872539206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a96bfa-84f2-42d1-aa56-21a7fd4f9097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:10Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Creating volume b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:13 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f3890a-6d1a-4333-a58a-8d6e8bfbe143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f941e252-2d96-437e-a582-e542975c9d41', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4340411-1fce-4123-91a2-2b39f8620004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:13 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 1073741824 Sep 28 18:30:13 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Volume volume-f941e252-2d96-437e-a582-e542975c9d41 (f941e252-2d96-437e-a582-e542975c9d41): created successfully Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4340411-1fce-4123-91a2-2b39f8620004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (d8b1dcbc-2416-4abf-8d0c-84a1310ecc26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fb7d784e-7a82-4bd1-8a74-9795b57d5be4 tempest-CreateVolumesFromImageTest-676001363 None] Created volume successfully. Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Flow 'volume_create_manager' (843c3874-70e9-4b91-8d5e-2e7b88c4ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d889aa-6bbb-4f57-b47d-6c33ca5076df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d889aa-6bbb-4f57-b47d-6c33ca5076df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a64deb-05b9-4388-9d60-736ad91e8c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93e2dc84c714a92bab9e6480d8ede06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:13Z,use_quota=True,user_id='a90299a50d804049bdacdce47baa7b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e75d6472-9f4f-4f75-aaf6-2e4968658535),volume_type_id=e75d6472-9f4f-4f75-aaf6-2e4968658535)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9870dd-165c-4b82-8c2a-344924d29b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9870dd-165c-4b82-8c2a-344924d29b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bcb88a-5913-4de0-9fa0-ca8b520fa715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:30:13 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 1073741824" returned: 0 in 0.576s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:13 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 Sep 28 18:30:13 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bcb88a-5913-4de0-9fa0-ca8b520fa715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1a64deb-05b9-4388-9d60-736ad91e8c8c', 'volume_name': 'volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c', 'volume_size': 1, 'image_id': '0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0ded199adda2cee72ae3632cd8cbc073', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b93e2dc84c714a92bab9e6480d8ede06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b90b597b2c4949240f69c65081526b1841f57b86d9cb39b4114873e02e0244bbeae1ef83fb7d53a47ff2b580eb2aea2f219d53e103d4296ded31fd94a611a579', 'id': '0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'created_at': datetime.datetime(2026, 9, 28, 16, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4961b1-cbe3-415b-a9ac-c8fdf5e42bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4961b1-cbe3-415b-a9ac-c8fdf5e42bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:13 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fd7a10-b99a-4467-9d9e-9c2795ec69df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:13 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Volume a1a64deb-05b9-4388-9d60-736ad91e8c8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c', 'volume_size': 1, 'image_id': '0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0ded199adda2cee72ae3632cd8cbc073', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b93e2dc84c714a92bab9e6480d8ede06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b90b597b2c4949240f69c65081526b1841f57b86d9cb39b4114873e02e0244bbeae1ef83fb7d53a47ff2b580eb2aea2f219d53e103d4296ded31fd94a611a579', 'id': '0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'created_at': datetime.datetime(2026, 9, 28, 16, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Trying to clone a1a64deb-05b9-4388-9d60-736ad91e8c8c from image 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:30:14 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2769c503-c4ee-412f-b314-198614d3360e]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:14 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097" returned: 0 in 0.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.817s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820629602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f17a65-0d9e-4d60-bbf6-128e601d3aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:10Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Creating volume c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:14 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4b77f1-a9d3-42bf-b9f3-62144e48d0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e0eb00-e646-4357-868e-b37a43585b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:14 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD Sep 28 18:30:14 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:14 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Volume volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 (b2a96bfa-84f2-42d1-aa56-21a7fd4f9097): created successfully Sep 28 18:30:14 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 1073741824 Sep 28 18:30:14 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e0eb00-e646-4357-868e-b37a43585b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (3d3267d3-e435-4b2d-9122-2cf14a79f7e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:14 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-df48dee1-de91-4199-8c9a-9f842f6c4eba tempest-CreateVolumesFromImageTest-676001363 None] Created volume successfully. Sep 28 18:30:14 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:14 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD Sep 28 18:30:14 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:14 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 1073741824" returned: 0 in 0.526s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:14 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 Sep 28 18:30:14 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:14 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:30:14 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Temporary image 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 is fetched for user a90299a50d804049bdacdce47baa7b51. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eb95bf-2bad-4c3b-86d9-1bc1c2603394]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7" returned: 0 in 0.285s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2010218967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e49062-da5b-4efa-993d-c0d20cbcb63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a1f255654b4cddbdb38d44aa391a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:11Z,use_quota=True,user_id='7795c5b88d654db5ba0b668ab1f28cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Creating volume 87e49062-da5b-4efa-993d-c0d20cbcb63e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:15 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22b009f-a5cd-4b5e-a6d8-55d3695be779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38e0cdb-b031-41a1-a6d5-dd35acd907e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:15 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e 1073741824 Sep 28 18:30:15 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD Sep 28 18:30:15 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 (c6f17a65-0d9e-4d60-bbf6-128e601d3aa7): created successfully Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38e0cdb-b031-41a1-a6d5-dd35acd907e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (d51fd1be-ab1e-44b2-866a-ff6c7ec31241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:15 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-804107ea-b164-4803-9410-d7169898da58 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created volume successfully. Sep 28 18:30:15 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD Sep 28 18:30:15 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e 1073741824" returned: 0 in 0.523s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e Sep 28 18:30:15 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:15 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e" returned: 0 in 0.299s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.748s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282441274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646aee85-0394-44e6-a1cf-ed0577bec8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:11Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Creating volume 646aee85-0394-44e6-a1cf-ed0577bec8b7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:15 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a335b9-7e2b-4e0d-b89e-9ca4d4a80db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e49062-da5b-4efa-993d-c0d20cbcb63e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c10487-ede0-4872-9e4f-175c7c00b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:16 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 1073741824 Sep 28 18:30:16 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Volume volume-87e49062-da5b-4efa-993d-c0d20cbcb63e (87e49062-da5b-4efa-993d-c0d20cbcb63e): created successfully Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c10487-ede0-4872-9e4f-175c7c00b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Flow 'volume_create_manager' (ddf2542e-ad96-429c-852a-13acae87aefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-68408fe6-bdcf-412c-a282-3e0a23ab4650 tempest-CreateVolumesFromImageTest-676001363 None] Created volume successfully. Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-87e49062-da5b-4efa-993d-c0d20cbcb63e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-87e49062-da5b-4efa-993d-c0d20cbcb63e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-quobyte-87e49062-da5b-4efa-993d-c0d20cbcb63e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-87e49062-da5b-4efa-993d-c0d20cbcb63e" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b042a7-060c-44b5-80ef-d8a96f7da71d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:16 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e Sep 28 18:30:16 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 1073741824" returned: 0 in 0.563s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:16 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 Sep 28 18:30:16 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e" returned: 0 in 0.451s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:16 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e Sep 28 18:30:16 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7" returned: 0 in 0.279s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.435s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-617810827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63130665-4280-44a5-9869-2e3b80e7db95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:11Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Creating volume 63130665-4280-44a5-9869-2e3b80e7db95 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:16 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6808ccca-72a3-4497-bb14-a2ac9173b446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646aee85-0394-44e6-a1cf-ed0577bec8b7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:16 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 1073741824 Sep 28 18:30:16 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f7f934-2046-42af-95ed-9cdfb9fb0bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:16 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 (646aee85-0394-44e6-a1cf-ed0577bec8b7): created successfully Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f7f934-2046-42af-95ed-9cdfb9fb0bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (1cbac634-a109-4c6b-b5ac-0b2e802eb92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1453aa1e-6a4c-4a32-9c53-0695173c395c tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created volume successfully. Sep 28 18:30:17 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-87e49062-da5b-4efa-993d-c0d20cbcb63e" returned: 0 in 0.288s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-87e49062-da5b-4efa-993d-c0d20cbcb63e" released by "delete_volume" :: held 0.788s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Created reservations ['93a591c2-2823-454d-9ac5-2b48340b0874', 'c7045515-b9c9-4afb-b27f-900c86bf8361', '70d52df2-43b6-489c-a7ba-d35dfc076dc4', '16351140-2e96-4ab5-a920-1814b13787db'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:17 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 1073741824" returned: 0 in 0.548s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:17 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 Sep 28 18:30:17 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-quobyte-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:17 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.358s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Deleted volume successfully. Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e655dbe2-9948-4f65-900f-3bb21d0045c8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c2dbcd11-cbf4-475e-8d94-c8d4a514e723 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-87e49062-da5b-4efa-993d-c0d20cbcb63e-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:17 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 Sep 28 18:30:17 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95" returned: 0 in 0.328s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.895s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-943633404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9bf2720-a89b-4dd7-9fee-ee97f362818e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:12Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Creating volume e9bf2720-a89b-4dd7-9fee-ee97f362818e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:17 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45bc0c80-1bca-4961-8e23-e270ed3a8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63130665-4280-44a5-9869-2e3b80e7db95', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:17 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e 1073741824 Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a956db-5297-4a0d-a7f7-2a365b86b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:17 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume volume-63130665-4280-44a5-9869-2e3b80e7db95 (63130665-4280-44a5-9869-2e3b80e7db95): created successfully Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a956db-5297-4a0d-a7f7-2a365b86b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (f786d179-d0ce-4a62-a18e-39cdfd960bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-352564aa-4256-4ce0-aa6f-7e40f5fbb9df tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created volume successfully. Sep 28 18:30:18 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097" returned: 0 in 0.404s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:18 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097 Sep 28 18:30:18 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:18 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e 1073741824" returned: 0 in 0.493s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:18 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097" returned: 0 in 0.285s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097" released by "delete_volume" :: held 0.775s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:18 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e Sep 28 18:30:18 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Created reservations ['dc18b7b8-7cff-42e4-b160-e13703979ee9', '6ae2a9fb-bcf1-4e36-82bb-b8277dddb1b9', '4b095f12-24dc-4e16-97a7-9a8f8c0c773f', 'c41bdbc3-8aac-4d08-89f3-9033beb91571'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:18 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:18 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-f941e252-2d96-437e-a582-e542975c9d41-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:18 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e" returned: 0 in 0.332s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-f941e252-2d96-437e-a582-e542975c9d41-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.358s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197067355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80065ec-d270-4e27-9826-8177141f4ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbe1e179b58494d8dc718f65a2519ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:12Z,use_quota=True,user_id='da9aa7b45bcd4b7987a82524c676efd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:18 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 1073741824 Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Creating volume e80065ec-d270-4e27-9826-8177141f4ad7 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:18 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:18 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563f1bb0-4233-45d2-8bc7-c409cc59008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d0f1d5-1eef-45e4-935a-b7dd21c7cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:18 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e (e9bf2720-a89b-4dd7-9fee-ee97f362818e): created successfully Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d0f1d5-1eef-45e4-935a-b7dd21c7cecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (8c399a99-d337-4af1-bfb6-27d1de05528d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-quobyte-f941e252-2d96-437e-a582-e542975c9d41" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-cac49d0f-e6cb-48bd-ac87-76c356421667 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created volume successfully. Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-f941e252-2d96-437e-a582-e542975c9d41" acquired by "delete_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[722fdd95-a67b-46da-9881-8f3f9a768b60]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:18 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.455s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Deleted volume successfully. Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-1ac0fd8e-ac13-4ae9-9b51-e5be715fda03 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-b2a96bfa-84f2-42d1-aa56-21a7fd4f9097-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:19 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 Sep 28 18:30:19 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:19 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 1073741824" returned: 0 in 0.582s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:19 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 Sep 28 18:30:19 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:19 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41" returned: 0 in 0.522s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:19 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41 Sep 28 18:30:19 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:19 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7" returned: 0 in 0.302s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.123s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Creating offline snapshot 5daab443-1d20-4622-9b9e-0be5279271ba of volume 3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f80d8b6-4b79-4c19-9a00-db690397dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80065ec-d270-4e27-9826-8177141f4ad7', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ffa833-b834-44cb-9801-1634e1f0e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0108014-ea3b-4cea-a1e2-523684b2d81f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Volume volume-e80065ec-d270-4e27-9826-8177141f4ad7 (e80065ec-d270-4e27-9826-8177141f4ad7): created successfully Sep 28 18:30:19 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ffa833-b834-44cb-9801-1634e1f0e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Flow 'volume_create_manager' (592e4e9c-9b0e-40fc-bdc3-9786ffb9ddce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f941e252-2d96-437e-a582-e542975c9d41" returned: 0 in 0.304s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6e17dab0-efb3-47ac-83a0-fa92a838f94b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created volume successfully. Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-f941e252-2d96-437e-a582-e542975c9d41" released by "delete_volume" :: held 0.898s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:19 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Created reservations ['335f7c54-ec39-4114-b13b-87242252c3cb', 'e915c810-70b7-478a-9d49-0eb2df42f3df', 'baf4a427-fe1f-4a91-8750-c945c304094d', '15aa83b9-ee32-4e63-b394-466308765b08'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:19 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d Sep 28 18:30:19 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:20 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:20 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-e80065ec-d270-4e27-9826-8177141f4ad7-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-e80065ec-d270-4e27-9826-8177141f4ad7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-quobyte-e80065ec-d270-4e27-9826-8177141f4ad7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-e80065ec-d270-4e27-9826-8177141f4ad7" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3af0b7-28bf-425c-b7c3-010707db3480]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:20 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d" returned: 0 in 0.530s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:20 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba 1G Sep 28 18:30:20 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:20 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.348s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:20 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Deleted volume successfully. Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e37fd971-0b3a-4bcf-b40c-cd80be69cce1 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-f941e252-2d96-437e-a582-e542975c9d41-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:20 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 Sep 28 18:30:20 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:20 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7" returned: 0 in 0.494s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:20 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7 Sep 28 18:30:20 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:20 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba 1G" returned: 0 in 0.500s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3913d1c7-a620-4c84-b244-40346d17772d -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:20 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3913d1c7-a620-4c84-b244-40346d17772d -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba Sep 28 18:30:20 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:20 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-f08295d9-0b01-4592-a4d3-b9f740800dc5-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-f08295d9-0b01-4592-a4d3-b9f740800dc5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-quobyte-f08295d9-0b01-4592-a4d3-b9f740800dc5" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-f08295d9-0b01-4592-a4d3-b9f740800dc5" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1491a8f-f6bd-4187-bdca-709cabf781f2]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e80065ec-d270-4e27-9826-8177141f4ad7" returned: 0 in 0.366s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-e80065ec-d270-4e27-9826-8177141f4ad7" released by "delete_volume" :: held 0.920s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3913d1c7-a620-4c84-b244-40346d17772d -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba" returned: 0 in 0.353s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba is being set with open permissions: ugo+rw Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba Sep 28 18:30:21 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created reservations ['533f8aee-4d51-49f3-9651-5134d1c78002', 'af42e07c-719e-4b3c-b65f-03735fdcd2cb', 'e08bbca7-4785-4ae2-b7c5-a2f163126cd4', '13252677-f062-4403-9dd7-2f737d5e8198'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:21 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 Sep 28 18:30:21 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:21 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-e9bf2720-a89b-4dd7-9fee-ee97f362818e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-e9bf2720-a89b-4dd7-9fee-ee97f362818e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-quobyte-e9bf2720-a89b-4dd7-9fee-ee97f362818e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:21 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba" returned: 0 in 0.323s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-e9bf2720-a89b-4dd7-9fee-ee97f362818e" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ae584-1348-412c-82ac-e451773e3cce]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.info Sep 28 18:30:21 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:21 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5" returned: 0 in 0.534s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5 Sep 28 18:30:21 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:21 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e Sep 28 18:30:21 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:21 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.380s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Deleted volume successfully. Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-394b1b74-2bdb-4bda-8217-924c74cad778 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-e80065ec-d270-4e27-9826-8177141f4ad7-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:21 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.info" returned: 0 in 0.323s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.info is being set with open permissions: ugo+rw Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:21 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.info Sep 28 18:30:21 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:21 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f08295d9-0b01-4592-a4d3-b9f740800dc5" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-f08295d9-0b01-4592-a4d3-b9f740800dc5" released by "delete_volume" :: held 0.906s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:21 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e" returned: 0 in 0.459s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:22 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e Sep 28 18:30:22 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Created reservations ['80d2cc6d-9490-4398-81a2-669e73b1cf62', '0aa7078b-4ddb-483f-a1b8-b6bac08f4641', '80a89f50-0797-4bc3-93e6-5e3666790797', 'd45fa14c-0e44-47ce-9ebf-175f52a79f26'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:22 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.info" returned: 0 in 0.343s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:22 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:22 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.449s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a64deb-05b9-4388-9d60-736ad91e8c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93e2dc84c714a92bab9e6480d8ede06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:13Z,use_quota=True,user_id='a90299a50d804049bdacdce47baa7b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e75d6472-9f4f-4f75-aaf6-2e4968658535),volume_type_id=e75d6472-9f4f-4f75-aaf6-2e4968658535)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Creating volume a1a64deb-05b9-4388-9d60-736ad91e8c8c {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:22 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-3fd910c9-066e-4101-afe7-68a3fc1e012b-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:22 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e9bf2720-a89b-4dd7-9fee-ee97f362818e" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:22 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c 1073741824 Sep 28 18:30:22 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-e9bf2720-a89b-4dd7-9fee-ee97f362818e" released by "delete_volume" :: held 0.875s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-3fd910c9-066e-4101-afe7-68a3fc1e012b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c06234e7-0436-468f-9860-9790dba3c3b3 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Create snapshot completed successfully Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "cinder-quobyte-3fd910c9-066e-4101-afe7-68a3fc1e012b" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-3fd910c9-066e-4101-afe7-68a3fc1e012b" acquired by "delete_volume" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created reservations ['660e90ba-ccd4-4517-a0e8-b6ade1bd81e6', '4c3bc03e-3d61-435a-880e-0158f8714d89', 'bc4fa4da-e9c6-4a54-b498-1b53fe4493f1', '03bb3818-2302-497e-a2a6-c41f3763b1c6'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9af40e-84ba-4c1e-937a-6328cdf087a5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:22 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.323s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Deleted volume successfully. Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ea55bd23-2ada-4e6e-8a04-d13f7aced6b2 tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-f08295d9-0b01-4592-a4d3-b9f740800dc5-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:22 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b Sep 28 18:30:22 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-63130665-4280-44a5-9869-2e3b80e7db95-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:22 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:22 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-63130665-4280-44a5-9869-2e3b80e7db95-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-quobyte-63130665-4280-44a5-9869-2e3b80e7db95" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-63130665-4280-44a5-9869-2e3b80e7db95" acquired by "delete_volume" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308247e-27c8-4c52-aa64-b89f4bd19b61]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 Sep 28 18:30:23 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c 1073741824" returned: 0 in 0.800s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b" returned: 0 in 0.604s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b Sep 28 18:30:23 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.495s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Deleted volume successfully. Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-5a6c56ef-3f7c-4510-b2bd-6f6adb1b7746 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-e9bf2720-a89b-4dd7-9fee-ee97f362818e-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:23 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c Sep 28 18:30:23 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3fd910c9-066e-4101-afe7-68a3fc1e012b" returned: 0 in 0.411s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-quobyte-3fd910c9-066e-4101-afe7-68a3fc1e012b" released by "delete_volume" :: held 1.088s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (b9525fce-f416-4dd2-b706-c224d330a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afd1027-dbc1-4b44-995c-4a7efc3dfbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:23 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c" returned: 0 in 0.373s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:23 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afd1027-dbc1-4b44-995c-4a7efc3dfbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2119483631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c290c77-ed2b-4a21-a478-062dcfb63067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:23Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8db0ef-d44c-45cd-b0da-b188d6254b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8db0ef-d44c-45cd-b0da-b188d6254b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3586ec17-33b5-4e9d-b856-67c8d1ee4351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3586ec17-33b5-4e9d-b856-67c8d1ee4351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c290c77-ed2b-4a21-a478-062dcfb63067', 'volume_name': 'volume-7c290c77-ed2b-4a21-a478-062dcfb63067', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac73646-47c3-4c1f-9f12-5207a22a3f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac73646-47c3-4c1f-9f12-5207a22a3f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43d0ed0-e873-48b0-a1b6-fbc8b716e4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:23 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume 7c290c77-ed2b-4a21-a478-062dcfb63067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c290c77-ed2b-4a21-a478-062dcfb63067', 'volume_size': 1} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2119483631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c290c77-ed2b-4a21-a478-062dcfb63067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:23Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Creating volume 7c290c77-ed2b-4a21-a478-062dcfb63067 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:23 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95" returned: 0 in 0.839s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 1073741824 Sep 28 18:30:23 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Attempting download of 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'metadata': {}}])) to volume a1a64deb-05b9-4388-9d60-736ad91e8c8c. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:30:23 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95 Sep 28 18:30:23 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Created reservations ['2e928fa6-55f1-4ef7-8125-067a48d87fb8', '9fb1facc-0a9f-4bc5-afa8-6236b558626d', '22d5928b-d49b-4422-a4be-5deccea47bdd', '54d790a2-c3bd-48ce-b601-7a7c9868f6be'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ecd61-4ee0-4f1e-b154-8cdd8f7878a2]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_id7g_qrs {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_id7g_qrs Sep 28 18:30:24 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:24 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (0dc530be-e78c-4f52-93ee-8633d9e3eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23fb1aa-89d8-4cf2-8a9f-0b40dcc6d968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-63130665-4280-44a5-9869-2e3b80e7db95" returned: 0 in 0.630s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23fb1aa-89d8-4cf2-8a9f-0b40dcc6d968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828287543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0cc1d3-288a-44c4-b011-15ec072c64d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:24Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:24 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f169bb-f128-4afb-82a1-98ce8b7309a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f169bb-f128-4afb-82a1-98ce8b7309a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70f228-96e6-4907-bbca-cc3382c31f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70f228-96e6-4907-bbca-cc3382c31f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0cc1d3-288a-44c4-b011-15ec072c64d1', 'volume_name': 'volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab0c458-edb2-4596-bc72-c6cea91252ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab0c458-edb2-4596-bc72-c6cea91252ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c23693-ae42-43f3-bdff-771f53f378d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume 8b0cc1d3-288a-44c4-b011-15ec072c64d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1', 'volume_size': 1} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-63130665-4280-44a5-9869-2e3b80e7db95" released by "delete_volume" :: held 1.580s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_id7g_qrs" returned: 0 in 0.521s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_id7g_qrs {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created reservations ['54a884b2-c8ea-4dc4-a8a0-3f8f6b41579b', 'de6ff41a-f98a-44e8-a70c-947320c7dc6c', 'ba2b4a18-aee7-4026-9587-3af56de60407', '417282ec-d976-4ab2-9281-e91ae489bc1f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.523s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:24 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Deleted volume successfully. Sep 28 18:30:24 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:24 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_id7g_qrs Sep 28 18:30:24 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 1073741824" returned: 0 in 0.935s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-23ef6a0a-d34e-4fe2-92af-6a9dad59dd2b tempest-CreateVolumesFromImageTest-676001363 None] Lock "cinder-3fd910c9-066e-4101-afe7-68a3fc1e012b-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 Sep 28 18:30:24 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:24 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (e394c5c0-8c98-4efd-9c8e-32cad0e2cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affc50d1-8894-4298-bc24-0eedca0a63dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affc50d1-8894-4298-bc24-0eedca0a63dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-738394601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e4501d-4bfd-45fd-b1bb-92d9d7234361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:25Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd63339-9ee0-4ead-bf9a-3b1f531f4c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd63339-9ee0-4ead-bf9a-3b1f531f4c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb642d4f-4a38-432e-b8d0-8ed7ad6d1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb642d4f-4a38-432e-b8d0-8ed7ad6d1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e4501d-4bfd-45fd-b1bb-92d9d7234361', 'volume_name': 'volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6df4c27-8ed4-442a-80a2-56421fb0ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6df4c27-8ed4-442a-80a2-56421fb0ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3009b87f-7cfb-4e0c-a70e-ce9247272e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:25 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume 52e4501d-4bfd-45fd-b1bb-92d9d7234361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361', 'volume_size': 1} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:25 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067" returned: 0 in 0.452s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:25 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828287543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0cc1d3-288a-44c4-b011-15ec072c64d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:24Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Creating volume 8b0cc1d3-288a-44c4-b011-15ec072c64d1 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:25 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:25 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-646aee85-0394-44e6-a1cf-ed0577bec8b7-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_id7g_qrs" returned: 1 in 0.805s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_id7g_qrs' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.477s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8790d4e3-482b-4731-aee4-8a4ba1771437]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:25 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 1073741824 Sep 28 18:30:25 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43d0ed0-e873-48b0-a1b6-fbc8b716e4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c290c77-ed2b-4a21-a478-062dcfb63067', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5384f6-7fe5-4844-a4a9-fc60cabb27ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Deleted volume successfully. Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-646aee85-0394-44e6-a1cf-ed0577bec8b7-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:25 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume volume-7c290c77-ed2b-4a21-a478-062dcfb63067 (7c290c77-ed2b-4a21-a478-062dcfb63067): created successfully Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5384f6-7fe5-4844-a4a9-fc60cabb27ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (b9525fce-f416-4dd2-b706-c224d330a00b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:25 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD Sep 28 18:30:25 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a44f0d1c-02d5-411a-95a3-542adcb0b257 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created volume successfully. Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-18a1504f-160f-48a4-88c6-e9bc1a5be32b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-63130665-4280-44a5-9869-2e3b80e7db95-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-quobyte-646aee85-0394-44e6-a1cf-ed0577bec8b7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-646aee85-0394-44e6-a1cf-ed0577bec8b7" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[988c3284-b9e0-4364-a275-c48ffc3e6950]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:25 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 Sep 28 18:30:25 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (4191bfcf-bf8f-48b1-b912-8e9276ad9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058ba185-ce32-4e6c-b65e-922edd25d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:26 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058ba185-ce32-4e6c-b65e-922edd25d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080651041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9ef99b-5cfb-429c-aa7f-05212a692880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:26Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920064c-c63d-43cc-a9fe-1ab4f49af7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920064c-c63d-43cc-a9fe-1ab4f49af7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5a6505-908d-489f-a791-0656454503d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5a6505-908d-489f-a791-0656454503d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9ef99b-5cfb-429c-aa7f-05212a692880', 'volume_name': 'volume-ac9ef99b-5cfb-429c-aa7f-05212a692880', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16299c2-2bcf-4fc9-ad8b-05747450bdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16299c2-2bcf-4fc9-ad8b-05747450bdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b7e50-bb95-4933-921b-ba55f8fd4600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume ac9ef99b-5cfb-429c-aa7f-05212a692880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9ef99b-5cfb-429c-aa7f-05212a692880', 'volume_size': 1} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 1073741824" returned: 0 in 0.947s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:26 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 Sep 28 18:30:26 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:26 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD Sep 28 18:30:26 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:26 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7" returned: 0 in 0.826s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:26 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7 Sep 28 18:30:26 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (3bf8f527-7a24-4ee9-b89e-74a9944ef89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254d99ec-b44f-47c1-9f9a-4055a6fa2dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254d99ec-b44f-47c1-9f9a-4055a6fa2dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566667152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84210a5e-d44f-4e5e-81e3-45cf879f6862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:26Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27402203-e689-4d3b-91d8-c060c4405159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27402203-e689-4d3b-91d8-c060c4405159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa632819-cf85-4512-8e81-9c9f97666a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa632819-cf85-4512-8e81-9c9f97666a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84210a5e-d44f-4e5e-81e3-45cf879f6862', 'volume_name': 'volume-84210a5e-d44f-4e5e-81e3-45cf879f6862', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ee3c87-ff33-4aa5-bf91-d1a0a1aa4e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ee3c87-ff33-4aa5-bf91-d1a0a1aa4e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9097a0c8-b709-4469-b484-9de869bbe845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume 84210a5e-d44f-4e5e-81e3-45cf879f6862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84210a5e-d44f-4e5e-81e3-45cf879f6862', 'volume_size': 1} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD" returned: 1 in 0.601s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 was raw, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:26 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1" returned: 0 in 0.546s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:26 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.781s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-738394601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e4501d-4bfd-45fd-b1bb-92d9d7234361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:25Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Creating volume 52e4501d-4bfd-45fd-b1bb-92d9d7234361 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:26 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:26 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c23693-ae42-43f3-bdff-771f53f378d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e00628-ec4d-41cb-921a-cb179992333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:26 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 1073741824 Sep 28 18:30:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 (8b0cc1d3-288a-44c4-b011-15ec072c64d1): created successfully Sep 28 18:30:26 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e00628-ec4d-41cb-921a-cb179992333b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (0dc530be-e78c-4f52-93ee-8633d9e3eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:26 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-321b3584-a6de-40dd-8102-9366897e3246 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created volume successfully. Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-646aee85-0394-44e6-a1cf-ed0577bec8b7" returned: 0 in 0.426s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-646aee85-0394-44e6-a1cf-ed0577bec8b7" released by "delete_volume" :: held 1.322s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created reservations ['60a01fe3-9247-498f-9909-34cc34c255ec', '1319ec86-a590-4d77-b618-c745ac157f87', '34d6ad86-9b2d-4f94-8b64-591fbc81dafa', '4c0dbe0c-4df5-4580-879d-33c048877ef3'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:27 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:27 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:27 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:27 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c" returned: 0 in 0.915s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8_yh9z6ziadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:30:27 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.616s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:27 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c 1G Sep 28 18:30:27 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Deleted volume successfully. Sep 28 18:30:27 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 1073741824" returned: 0 in 0.973s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e73e8074-555e-4f7a-aac2-58086991102b tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-646aee85-0394-44e6-a1cf-ed0577bec8b7-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-quobyte-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[622cb84b-5363-442e-bca5-9a9138ccf199]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:27 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 Sep 28 18:30:27 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 Sep 28 18:30:28 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c 1G" returned: 0 in 0.508s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Downloaded image 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'metadata': {}}])) to volume a1a64deb-05b9-4388-9d60-736ad91e8c8c successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Temporary image 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 for user a90299a50d804049bdacdce47baa7b51 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Marking volume a1a64deb-05b9-4388-9d60-736ad91e8c8c as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Copying metadata from image 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 to a1a64deb-05b9-4388-9d60-736ad91e8c8c. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Creating volume glance metadata for volume a1a64deb-05b9-4388-9d60-736ad91e8c8c backed by image 0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0ded199adda2cee72ae3632cd8cbc073', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:30:28 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361" returned: 0 in 0.396s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080651041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9ef99b-5cfb-429c-aa7f-05212a692880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:26Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Creating volume ac9ef99b-5cfb-429c-aa7f-05212a692880 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:28 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3009b87f-7cfb-4e0c-a70e-ce9247272e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b294011-1798-462f-ba95-dfc12887ab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:28 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 1073741824 Sep 28 18:30:28 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 (52e4501d-4bfd-45fd-b1bb-92d9d7234361): created successfully Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b294011-1798-462f-ba95-dfc12887ab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (e394c5c0-8c98-4efd-9c8e-32cad0e2cc91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-861a00a3-8cac-4232-936b-4b3fb38fa46d tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created volume successfully. Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fd7a10-b99a-4467-9d9e-9c2795ec69df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c', 'volume_size': 1, 'image_id': '0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0ded199adda2cee72ae3632cd8cbc073', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b93e2dc84c714a92bab9e6480d8ede06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b90b597b2c4949240f69c65081526b1841f57b86d9cb39b4114873e02e0244bbeae1ef83fb7d53a47ff2b580eb2aea2f219d53e103d4296ded31fd94a611a579', 'id': '0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8', 'created_at': datetime.datetime(2026, 9, 28, 16, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0aecbc9a-2c38-413e-a62e-ba6af7b1e0b8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e795297e-2651-4a07-9e6a-63d1cd8cf270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:28 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7" returned: 0 in 0.548s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Volume volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c (a1a64deb-05b9-4388-9d60-736ad91e8c8c): created successfully Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e795297e-2651-4a07-9e6a-63d1cd8cf270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Flow 'volume_create_manager' (843c3874-70e9-4b91-8d5e-2e7b88c4ce94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d3a6b797-a1db-420e-b624-b08110e7431d tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Created volume successfully. Sep 28 18:30:28 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7 Sep 28 18:30:28 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7" returned: 0 in 0.454s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7" released by "delete_volume" :: held 1.077s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Acquiring lock "cinder-a1a64deb-05b9-4388-9d60-736ad91e8c8c-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:28 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "cinder-a1a64deb-05b9-4388-9d60-736ad91e8c8c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:29 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 1073741824" returned: 0 in 0.726s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created reservations ['ab083ebf-df8a-4cc8-837f-83d8233f9534', 'e8c22e33-528a-4dc3-b1c7-3aaa7c26e15e', '5b528a09-6ed7-4771-a775-c0f5c756593d', 'edb62ee3-b230-4f3c-b3ad-6c22a2195e1d'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Acquiring lock "cinder-quobyte-a1a64deb-05b9-4388-9d60-736ad91e8c8c" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "cinder-quobyte-a1a64deb-05b9-4388-9d60-736ad91e8c8c" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[024393c1-b74b-4d5a-8292-dc3b2b9b12e5]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:29 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 Sep 28 18:30:29 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:29 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:29 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:29 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c Sep 28 18:30:29 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:29 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880" returned: 0 in 0.363s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.736s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566667152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84210a5e-d44f-4e5e-81e3-45cf879f6862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8d98e99ee34c568c03bc45da616a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:26Z,use_quota=True,user_id='cf970099d8a84c0a954972c8d59a159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Creating volume 84210a5e-d44f-4e5e-81e3-45cf879f6862 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:29 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b7e50-bb95-4933-921b-ba55f8fd4600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9ef99b-5cfb-429c-aa7f-05212a692880', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:29 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 1073741824 Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a843635e-d4b6-41a4-acff-91d7bb2f1b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:29 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:29 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 (ac9ef99b-5cfb-429c-aa7f-05212a692880): created successfully Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a843635e-d4b6-41a4-acff-91d7bb2f1b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (4191bfcf-bf8f-48b1-b912-8e9276ad9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:29 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c" returned: 0 in 0.460s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:29 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.407s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:29 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5be410e4-ef18-451f-9045-edcb7671f81c tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created volume successfully. Sep 28 18:30:29 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Deleted volume successfully. Sep 28 18:30:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-9168bf79-5939-46bb-b8ca-c0b3fad12cc7 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-c6f17a65-0d9e-4d60-bbf6-128e601d3aa7-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:29 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c Sep 28 18:30:29 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:30 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a1a64deb-05b9-4388-9d60-736ad91e8c8c" returned: 0 in 0.468s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "cinder-quobyte-a1a64deb-05b9-4388-9d60-736ad91e8c8c" released by "delete_volume" :: held 1.034s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "cinder-quobyte-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a" acquired by "delete_volume" :: waited 0.030s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd21e6-1e4b-4c51-b3ed-a9c705281f93]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:30 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 1073741824" returned: 0 in 0.738s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Created reservations ['cbd15bd9-d778-497c-95ae-e09a75aa0304', 'c479d2a4-cf1c-4b36-8801-5cc35d375085', 'd9c2f832-5435-470e-b0fe-95b0d0701730', '73eaf84d-9495-4256-a558-f072eaf493df'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:30 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a Sep 28 18:30:30 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 Sep 28 18:30:30 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:30 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:30 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a" returned: 0 in 0.499s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:30 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862" returned: 0 in 0.422s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:30 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a Sep 28 18:30:30 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9097a0c8-b709-4469-b484-9de869bbe845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84210a5e-d44f-4e5e-81e3-45cf879f6862', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd187dd-ca11-4805-99e2-fa3627803c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:30 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Volume volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 (84210a5e-d44f-4e5e-81e3-45cf879f6862): created successfully Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd187dd-ca11-4805-99e2-fa3627803c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Flow 'volume_create_manager' (3bf8f527-7a24-4ee9-b89e-74a9944ef89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:30 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.396s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-33c0934f-af39-4afe-a589-7c9b2c3cc230 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created volume successfully. Sep 28 18:30:30 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Deleted volume successfully. Sep 28 18:30:30 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3c665635-4fbf-4472-ac8a-5529f231b31b tempest-VolumeAndVolumeTypeFromImageTest-605801112 None] Lock "cinder-a1a64deb-05b9-4388-9d60-736ad91e8c8c-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:31 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a" returned: 0 in 0.338s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-quobyte-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a" released by "delete_volume" :: held 0.907s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Created reservations ['84c73d72-342f-4dc0-8e04-353625623190', '483324ee-4802-46a4-ac3c-473f9ede7970', '557e598e-1665-429c-aeeb-8a3e32a0bc2c', '55d7ebc8-c2af-4f92-ae61-0ce3a2ebd9ef'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:31 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-84210a5e-d44f-4e5e-81e3-45cf879f6862-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-84210a5e-d44f-4e5e-81e3-45cf879f6862-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-84210a5e-d44f-4e5e-81e3-45cf879f6862" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-84210a5e-d44f-4e5e-81e3-45cf879f6862" acquired by "delete_volume" :: waited 0.034s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[252b95ed-6401-4742-aa46-3fa4c5460b69]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.475s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:31 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 Sep 28 18:30:31 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Deleted volume successfully. Sep 28 18:30:31 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:31 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-e7ed9fe8-c055-43e3-8717-f20ebe5d5d09 tempest-CreateVolumesFromSourceVolumeTest-1762771567 None] Lock "cinder-9e92c3ad-9331-4b2a-91e1-132f95ddbc6a-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:32 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862" returned: 0 in 0.590s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:32 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862 Sep 28 18:30:32 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:32 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-84210a5e-d44f-4e5e-81e3-45cf879f6862" returned: 0 in 0.322s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-84210a5e-d44f-4e5e-81e3-45cf879f6862" released by "delete_volume" :: held 1.000s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created reservations ['194377ae-6daa-4576-ad44-29976b3b7ff2', 'b1cc2325-33dd-4448-920d-40014e62e226', 'f8980bc0-87de-415f-a6c2-5f51a95b191c', '2fa8eebc-ff62-4c1b-a410-eb82956ccf44'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:32 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:32 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:33 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.430s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:33 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Deleted volume successfully. Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-50586ffb-f305-425a-b37e-b39baab4e17b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-84210a5e-d44f-4e5e-81e3-45cf879f6862-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-ac9ef99b-5cfb-429c-aa7f-05212a692880-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-ac9ef99b-5cfb-429c-aa7f-05212a692880-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-ac9ef99b-5cfb-429c-aa7f-05212a692880" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-ac9ef99b-5cfb-429c-aa7f-05212a692880" acquired by "delete_volume" :: waited 0.044s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d9b79-dc56-4522-aa83-c7bd04037093]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:34 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 Sep 28 18:30:34 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:34 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880" returned: 0 in 0.610s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:34 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880 Sep 28 18:30:34 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:34 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ac9ef99b-5cfb-429c-aa7f-05212a692880" returned: 0 in 0.342s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-ac9ef99b-5cfb-429c-aa7f-05212a692880" released by "delete_volume" :: held 1.052s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:34 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created reservations ['5e520f87-4590-44c4-98d4-5afef38b7a11', '09035dae-79d3-4caf-ad09-7fce3b4dc25d', 'c4f836a2-5699-456b-9759-991fdec25b3a', '3335394d-6260-443c-8cef-f83c761825a6'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:35 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:35 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:35 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.383s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Deleted volume successfully. Sep 28 18:30:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2e9b2cbf-bd78-496f-9b01-308da4778dac tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-ac9ef99b-5cfb-429c-aa7f-05212a692880-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-52e4501d-4bfd-45fd-b1bb-92d9d7234361-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-52e4501d-4bfd-45fd-b1bb-92d9d7234361-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-52e4501d-4bfd-45fd-b1bb-92d9d7234361" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-52e4501d-4bfd-45fd-b1bb-92d9d7234361" acquired by "delete_volume" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25105db-72b4-48e3-8f91-675f674d8b70]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:36 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 Sep 28 18:30:36 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Flow 'volume_create_manager' (5ddabd3a-ba42-4feb-9637-5014dd7b37a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f13d0e9-fac8-4676-b6a1-cc3f5f779d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f13d0e9-fac8-4676-b6a1-cc3f5f779d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2087281270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272dc28a-4f33-445c-b6b2-3944882f1657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e31c97dce340b9aae7d64de5986500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:37Z,use_quota=True,user_id='15670cc640fe4ff2966106dda1fd0675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba71cf79-91c8-4db8-90ba-2f2e9a042521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba71cf79-91c8-4db8-90ba-2f2e9a042521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fd35fa-504c-4c4b-8acd-a7ab11c9e99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:36 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fd35fa-504c-4c4b-8acd-a7ab11c9e99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272dc28a-4f33-445c-b6b2-3944882f1657', 'volume_name': 'volume-272dc28a-4f33-445c-b6b2-3944882f1657', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba14fd7-c8a6-419d-bfbd-8ea760214bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba14fd7-c8a6-419d-bfbd-8ea760214bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac5b24f-991b-434c-bf40-202b7e086072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:36 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Volume 272dc28a-4f33-445c-b6b2-3944882f1657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272dc28a-4f33-445c-b6b2-3944882f1657', 'volume_size': 1} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2087281270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272dc28a-4f33-445c-b6b2-3944882f1657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e31c97dce340b9aae7d64de5986500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:37Z,use_quota=True,user_id='15670cc640fe4ff2966106dda1fd0675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Creating volume 272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:36 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361" returned: 0 in 0.592s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:36 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 1073741824 Sep 28 18:30:36 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:36 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361 Sep 28 18:30:36 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:37 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-52e4501d-4bfd-45fd-b1bb-92d9d7234361" returned: 0 in 0.412s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-52e4501d-4bfd-45fd-b1bb-92d9d7234361" released by "delete_volume" :: held 1.074s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created reservations ['fe81dceb-3422-4849-a41d-a485829319b1', 'e1e5944f-4666-41a8-be28-730f71e5dd6c', '5b86c9e5-d738-4d65-946f-c4492c5943ba', 'e4b18d9c-83df-4e7e-bc3b-2fb2fa7e9cab'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:37 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 1073741824" returned: 0 in 0.737s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:37 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:37 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:37 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 Sep 28 18:30:37 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:37 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.372s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:37 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Deleted volume successfully. Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-250e1428-7d86-4269-bb26-352bd4b179b0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-52e4501d-4bfd-45fd-b1bb-92d9d7234361-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:38 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657" returned: 0 in 0.391s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac5b24f-991b-434c-bf40-202b7e086072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272dc28a-4f33-445c-b6b2-3944882f1657', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9268c1-f387-4943-83d6-5bea4285994c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:38 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Volume volume-272dc28a-4f33-445c-b6b2-3944882f1657 (272dc28a-4f33-445c-b6b2-3944882f1657): created successfully Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9268c1-f387-4943-83d6-5bea4285994c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Flow 'volume_create_manager' (5ddabd3a-ba42-4feb-9637-5014dd7b37a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-930ef075-8f75-4d70-9f9c-835cbea230c2 tempest-VolumeDependencyTests-10833950 None] Created volume successfully. Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-8b0cc1d3-288a-44c4-b011-15ec072c64d1-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-8b0cc1d3-288a-44c4-b011-15ec072c64d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-8b0cc1d3-288a-44c4-b011-15ec072c64d1" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-8b0cc1d3-288a-44c4-b011-15ec072c64d1" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b8d195-7a1e-4928-b7a1-f788e014534c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:38 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 Sep 28 18:30:38 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:38 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:38 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Creating offline snapshot 3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 of volume 272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:39 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1" returned: 0 in 0.654s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b29fd-2f3b-46bb-a67d-5bb5874818b9]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1 Sep 28 18:30:39 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.545s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:30:39 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 Sep 28 18:30:39 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8b0cc1d3-288a-44c4-b011-15ec072c64d1" returned: 0 in 0.484s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-8b0cc1d3-288a-44c4-b011-15ec072c64d1" released by "delete_volume" :: held 1.209s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created reservations ['6df9258c-25fe-4540-960a-d424e9f28a81', '0c11d350-f2a5-4f2c-af23-9df498fc9d33', '69fb934f-0099-4cc4-bff1-e5408057ccb4', 'cd458825-cb4c-467f-9379-046ffa6963d5'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:39 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657" returned: 0 in 0.597s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 1G Sep 28 18:30:39 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:39 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:40 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.309s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Deleted volume successfully. Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d28d402c-07de-47a1-be76-6686fc0dcfda tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-8b0cc1d3-288a-44c4-b011-15ec072c64d1-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:40 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 1G" returned: 0 in 0.621s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272dc28a-4f33-445c-b6b2-3944882f1657 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:40 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272dc28a-4f33-445c-b6b2-3944882f1657 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 Sep 28 18:30:40 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-7c290c77-ed2b-4a21-a478-062dcfb63067-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-7c290c77-ed2b-4a21-a478-062dcfb63067-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-7c290c77-ed2b-4a21-a478-062dcfb63067" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-7c290c77-ed2b-4a21-a478-062dcfb63067" acquired by "delete_volume" :: waited 0.046s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be9450-4a8e-4c62-82e8-e5209ba40c63]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:41 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272dc28a-4f33-445c-b6b2-3944882f1657 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" returned: 0 in 0.554s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 is being set with open permissions: ugo+rw Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:41 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 Sep 28 18:30:41 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:41 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 Sep 28 18:30:41 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:41 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" returned: 0 in 0.344s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:41 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.info Sep 28 18:30:41 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:41 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067" returned: 0 in 0.573s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:41 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067 Sep 28 18:30:41 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:41 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.info" returned: 0 in 0.419s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.info is being set with open permissions: ugo+rw Sep 28 18:30:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:41 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.info Sep 28 18:30:41 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:42 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7c290c77-ed2b-4a21-a478-062dcfb63067" returned: 0 in 0.543s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-7c290c77-ed2b-4a21-a478-062dcfb63067" released by "delete_volume" :: held 1.198s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created reservations ['d2e8f039-da75-4d71-b6df-5a7bea32be53', 'cbb1a0f1-624d-4f8c-9671-88e755e4642b', '5f9fed25-a73d-4ba6-b413-d1ccd202dec5', '1e580236-867c-41ef-a704-f7739532e6f1'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:42 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.info" returned: 0 in 0.438s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b67de65b-35a9-4486-9a8a-b88065a987ba tempest-VolumeDependencyTests-10833950 None] Create snapshot completed successfully Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:42 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:42 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:42 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.258s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Deleted volume successfully. Sep 28 18:30:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-26324491-18fb-417f-ba70-f283e684ec7b tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-7c290c77-ed2b-4a21-a478-062dcfb63067-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-5daab443-1d20-4622-9b9e-0be5279271ba-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-5daab443-1d20-4622-9b9e-0be5279271ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-3913d1c7-a620-4c84-b244-40346d17772d" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-3913d1c7-a620-4c84-b244-40346d17772d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-5daab443-1d20-4622-9b9e-0be5279271ba" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-5daab443-1d20-4622-9b9e-0be5279271ba" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Deleting offline snapshot 5daab443-1d20-4622-9b9e-0be5279271ba of volume 3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] snapshot_file for this snap is: volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fdb2b9-f5b3-49a3-b4c8-6b15de16c298]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:43 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba Sep 28 18:30:43 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:43 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba" returned: 0 in 0.588s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3913d1c7-a620-4c84-b244-40346d17772d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e814866-dd50-4a0e-9430-989c799025d9]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d Sep 28 18:30:44 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d" returned: 0 in 0.479s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba Sep 28 18:30:44 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Flow 'volume_create_manager' (e51ffc8d-a5ee-4e46-a429-9d435dedc7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2a9543-312c-4c92-9c41-cd429b882820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2a9543-312c-4c92-9c41-cd429b882820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2125997050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522607cd-d033-4ee2-a546-185cd2502c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e31c97dce340b9aae7d64de5986500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fae2a22-fd1b-4504-a9d3-fffb916cc2a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:44Z,use_quota=True,user_id='15670cc640fe4ff2966106dda1fd0675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95215bc-8842-4371-bd96-28641b17e545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95215bc-8842-4371-bd96-28641b17e545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3873c4-7268-469e-bd41-c419978d59b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3873c4-7268-469e-bd41-c419978d59b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '522607cd-d033-4ee2-a546-185cd2502c20', 'volume_name': 'volume-522607cd-d033-4ee2-a546-185cd2502c20', 'volume_size': 1, 'snapshot_id': '3fae2a22-fd1b-4504-a9d3-fffb916cc2a2'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08ad764-ea34-4d47-96b1-2ecc1d3dd012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08ad764-ea34-4d47-96b1-2ecc1d3dd012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90b0bed-6639-44fa-9ea8-be0d08c87f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:44 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Volume 522607cd-d033-4ee2-a546-185cd2502c20: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-522607cd-d033-4ee2-a546-185cd2502c20', 'volume_size': 1, 'snapshot_id': '3fae2a22-fd1b-4504-a9d3-fffb916cc2a2'} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-quobyte-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2-522607cd-d033-4ee2-a546-185cd2502c20" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2-522607cd-d033-4ee2-a546-185cd2502c20" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Creating volume 522607cd-d033-4ee2-a546-185cd2502c20 from snapshot 3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-quobyte-522607cd-d033-4ee2-a546-185cd2502c20" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-522607cd-d033-4ee2-a546-185cd2502c20" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] snapshot: 3fae2a22-fd1b-4504-a9d3-fffb916cc2a2, volume: 522607cd-d033-4ee2-a546-185cd2502c20, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec024aeb-4414-4fc6-8ce7-2407451bc977]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 Sep 28 18:30:44 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba" returned: 0 in 0.476s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba Sep 28 18:30:44 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:45 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:45 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d.5daab443-1d20-4622-9b9e-0be5279271ba" returned: 0 in 0.306s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" returned: 0 in 0.458s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-272dc28a-4f33-445c-b6b2-3944882f1657(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ef2419-4e6b-4499-ac7d-1d6ca5a51909]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-5daab443-1d20-4622-9b9e-0be5279271ba" released by "_delete_snapshot" :: held 2.109s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-3913d1c7-a620-4c84-b244-40346d17772d" released by "delete_snapshot" :: held 2.162s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created reservations ['da28685e-3cbb-4d77-a9d2-7cce6dc4aefe', '5f11e954-45e1-45a8-9882-1c0b30092866', 'd662486c-4130-4133-95d4-58f95203c70c', '5499794a-5078-49bb-97c6-4cc5b867d1f5'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:45 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 Sep 28 18:30:45 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:45 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Delete snapshot completed successfully. Sep 28 18:30:45 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4679fd1a-3167-4649-9de4-2a909bbc93c0 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-5daab443-1d20-4622-9b9e-0be5279271ba-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:46 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657" returned: 0 in 0.666s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:46 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 Sep 28 18:30:46 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-3913d1c7-a620-4c84-b244-40346d17772d-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-3913d1c7-a620-4c84-b244-40346d17772d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "cinder-quobyte-3913d1c7-a620-4c84-b244-40346d17772d" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-3913d1c7-a620-4c84-b244-40346d17772d" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d03a67-76e5-4097-afe9-42ac8da15031]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:46 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d Sep 28 18:30:46 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:47 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d" returned: 0 in 1.071s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:47 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d Sep 28 18:30:47 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:48 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-3913d1c7-a620-4c84-b244-40346d17772d" returned: 0 in 0.949s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-quobyte-3913d1c7-a620-4c84-b244-40346d17772d" released by "delete_volume" :: held 2.177s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:48 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Created reservations ['5d6f9137-e3b0-4d55-a785-ef8317a9a336', '0cacf4a2-f788-4d52-bce9-5c28739a8049', '28998f65-57e5-410f-bc15-19e0a1f10756', '4c326b63-0822-412b-9ac3-a511b4870b75'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:49 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:30:49 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:49 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Deleted volume successfully. Sep 28 18:30:49 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ed6cc076-5d2f-4a47-ad4e-1cca79ec0922 tempest-CreateVolumesFromSnapshotTest-1198244559 None] Lock "cinder-3913d1c7-a620-4c84-b244-40346d17772d-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:54 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20" returned: 0 in 8.563s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:54 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657, size 1024.00 MB, duration 8.56 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:30:54 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Converted 1024.00 MB image at 119.56 MB/s Sep 28 18:30:54 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 is being set with open permissions: ugo+rw Sep 28 18:30:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:54 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 Sep 28 18:30:54 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:54 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20" returned: 0 in 0.272s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-522607cd-d033-4ee2-a546-185cd2502c20" released by "_copy_volume_from_snapshot" :: held 10.143s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2-522607cd-d033-4ee2-a546-185cd2502c20" released by "_create_volume_from_snapshot" :: held 11.347s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.372s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90b0bed-6639-44fa-9ea8-be0d08c87f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522607cd-d033-4ee2-a546-185cd2502c20', 'volume_size': 1, 'snapshot_id': '3fae2a22-fd1b-4504-a9d3-fffb916cc2a2'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f21354-c13a-4a5b-b319-10d2b5237063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:56 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Volume volume-522607cd-d033-4ee2-a546-185cd2502c20 (522607cd-d033-4ee2-a546-185cd2502c20): created successfully Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f21354-c13a-4a5b-b319-10d2b5237063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Flow 'volume_create_manager' (e51ffc8d-a5ee-4e46-a429-9d435dedc7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-efc84c15-b69c-48b9-88c2-345ec84ce794 tempest-VolumeDependencyTests-10833950 None] Created volume successfully. Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-quobyte-272dc28a-4f33-445c-b6b2-3944882f1657" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-272dc28a-4f33-445c-b6b2-3944882f1657" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-quobyte-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Deleting offline snapshot 3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 of volume 272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] snapshot_file for this snap is: volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b1885-649b-4ff0-ba16-3097ad7a88f8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:56 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 Sep 28 18:30:56 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:57 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" returned: 0 in 0.599s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-272dc28a-4f33-445c-b6b2-3944882f1657(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:57 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ccfd33-6d7d-462e-83c6-6538c85f37dc]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:57 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 Sep 28 18:30:57 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:58 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657" returned: 0 in 0.806s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:58 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 Sep 28 18:30:58 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:58 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" returned: 0 in 0.518s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:58 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2 Sep 28 18:30:58 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:59 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657.3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" returned: 0 in 0.423s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2" released by "_delete_snapshot" :: held 2.577s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-272dc28a-4f33-445c-b6b2-3944882f1657" released by "delete_snapshot" :: held 2.630s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (2a98dc76-7ca5-457c-9462-8482a845ddb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ece0d7-0a34-426b-9908-1fbfc20710ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ece0d7-0a34-426b-9908-1fbfc20710ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923160854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7842f8cb-47d6-4ce5-bb9a-d2e378042c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:59Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c4bb94-c5c3-4689-8648-0dec7a06ac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c4bb94-c5c3-4689-8648-0dec7a06ac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf336b7-cf9f-4033-ae55-6039c88fe53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf336b7-cf9f-4033-ae55-6039c88fe53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7842f8cb-47d6-4ce5-bb9a-d2e378042c74', 'volume_name': 'volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332d986f-ade8-4068-be90-4123bb3b5aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332d986f-ade8-4068-be90-4123bb3b5aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5eca4b0-50da-4ab7-8a22-67e3ead76f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:59 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Volume 7842f8cb-47d6-4ce5-bb9a-d2e378042c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74', 'volume_size': 1} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923160854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7842f8cb-47d6-4ce5-bb9a-d2e378042c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:59Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Creating volume 7842f8cb-47d6-4ce5-bb9a-d2e378042c74 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:59 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Created reservations ['ae9c11e8-dc56-4151-9dc0-31f3a2773afe', '3b766e5b-08c0-4558-a0f9-2aa3225b06d0', '393df93c-8b37-41a3-831d-da4432324839', 'f406aed0-defe-42e2-8a29-f5d8440e9fcf'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:59 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 1073741824 Sep 28 18:30:59 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:59 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Delete snapshot completed successfully. Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3155ff54-e490-4152-b30b-e9aa86e5bd87 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-3fae2a22-fd1b-4504-a9d3-fffb916cc2a2-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-272dc28a-4f33-445c-b6b2-3944882f1657-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-272dc28a-4f33-445c-b6b2-3944882f1657-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-quobyte-272dc28a-4f33-445c-b6b2-3944882f1657" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-272dc28a-4f33-445c-b6b2-3944882f1657" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa59127b-f73e-40a1-8809-657ff3654b23]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 1073741824" returned: 0 in 0.705s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 Sep 28 18:31:00 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 Sep 28 18:31:00 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657" returned: 0 in 0.709s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74" returned: 0 in 0.514s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:00 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657 Sep 28 18:31:00 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5eca4b0-50da-4ab7-8a22-67e3ead76f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d77e75-29bd-496b-9deb-a72984cbd833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Volume volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 (7842f8cb-47d6-4ce5-bb9a-d2e378042c74): created successfully Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d77e75-29bd-496b-9deb-a72984cbd833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (2a98dc76-7ca5-457c-9462-8482a845ddb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6adf485d-61f9-4cc3-a54a-369ea40871cb tempest-ProjectReaderTests-74922425 None] Created volume successfully. Sep 28 18:31:01 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-272dc28a-4f33-445c-b6b2-3944882f1657" returned: 0 in 0.335s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-272dc28a-4f33-445c-b6b2-3944882f1657" released by "delete_volume" :: held 1.144s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Created reservations ['546c6685-98bf-47cd-bdbd-fce57bf0d789', '48a0285a-0b36-463e-b7d6-0651e0d7b817', '13c4332b-c512-4ee3-aba1-de2477c39ee9', '69116284-441f-403a-aa7d-faf974a13a97'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:01 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:01 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:01 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.328s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:01 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Deleted volume successfully. Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ae4b0dd0-95eb-447f-ba78-2c392ebc1cf3 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-272dc28a-4f33-445c-b6b2-3944882f1657-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-7842f8cb-47d6-4ce5-bb9a-d2e378042c74-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Lock "cinder-7842f8cb-47d6-4ce5-bb9a-d2e378042c74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-quobyte-7842f8cb-47d6-4ce5-bb9a-d2e378042c74" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-7842f8cb-47d6-4ce5-bb9a-d2e378042c74" acquired by "delete_volume" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b795ea66-3879-492c-a272-e9a3aac7df8f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-522607cd-d033-4ee2-a546-185cd2502c20-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-522607cd-d033-4ee2-a546-185cd2502c20-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:02 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 Sep 28 18:31:02 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "cinder-quobyte-522607cd-d033-4ee2-a546-185cd2502c20" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-522607cd-d033-4ee2-a546-185cd2502c20" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[775d6c81-2486-494f-8114-31ba630cb08d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:02 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 Sep 28 18:31:02 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:02 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74" returned: 0 in 0.536s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:02 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74 Sep 28 18:31:02 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:02 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20" returned: 0 in 0.483s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:02 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20 Sep 28 18:31:02 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7842f8cb-47d6-4ce5-bb9a-d2e378042c74" returned: 0 in 0.361s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-7842f8cb-47d6-4ce5-bb9a-d2e378042c74" released by "delete_volume" :: held 0.963s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:03 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-522607cd-d033-4ee2-a546-185cd2502c20" returned: 0 in 0.368s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-quobyte-522607cd-d033-4ee2-a546-185cd2502c20" released by "delete_volume" :: held 0.913s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Created reservations ['2898ea1d-24ae-4cef-a3b9-43dce08d6051', 'ab31bbbc-34e9-400d-9d12-6ece12f08583', '387ea370-9ab6-4a9e-ac6f-2a4667be93c7', '5a13db7d-a792-4324-a502-a1d9749d7569'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Created reservations ['44d2cdb3-cf40-44a5-bb96-60be34e9a4b8', 'abae87be-3270-4493-8d75-212f35ba0ba4', 'c94e55aa-8ff0-4cf6-b6a8-13f06f94fbd3', '5e165eaa-fadc-4528-8763-fee9c8e1c3d5'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:03 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:03 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:03 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Flow 'volume_create_manager' (41c53b78-4b85-4478-9d31-99faaaedb159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd88e16-5e21-4d76-a9c1-bf761fbfc9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:03 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=186,cinder:UPDATE=261,cinder:INSERT=56,cinder:DELETE=17 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.386s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:03 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Deleted volume successfully. Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd88e16-5e21-4d76-a9c1-bf761fbfc9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836125a9-868b-4b15-b5ac-107062749694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839fa8e11f1e4993b356df88db3bef72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:04Z,use_quota=True,user_id='37417d69a3fb4cc1bb4f7d9e59a97905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5645ee0c-4d50-4b41-b75a-2266538623c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5645ee0c-4d50-4b41-b75a-2266538623c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a826d-5fef-48d6-a019-f08c5d0abb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.image.glance [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Creating Keystone auth plugin from conf {{(pid=86981) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=162,cinder:UPDATE=234,cinder:INSERT=69,cinder:DELETE=26 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4071987f-928a-4f05-b3f6-f51bfb6289e1 tempest-VolumeDependencyTests-10833950 None] Lock "cinder-522607cd-d033-4ee2-a546-185cd2502c20-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:03 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.449s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Deleted volume successfully. Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-b0516bf2-4512-41b5-98c1-8804f23335e5 tempest-ProjectReaderTests-74922425 None] Lock "cinder-7842f8cb-47d6-4ce5-bb9a-d2e378042c74-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a826d-5fef-48d6-a019-f08c5d0abb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '836125a9-868b-4b15-b5ac-107062749694', 'volume_name': 'volume-836125a9-868b-4b15-b5ac-107062749694', 'volume_size': 1, 'image_id': 'f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49dc2b8b7b1da8657a2c990a780f0a94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '839fa8e11f1e4993b356df88db3bef72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9de3463dac9666895c06e875b35918b371027b98c5651e21f2a26123990e45e5810bca8ef642f6aa3302335ccb33ef6eb727ab9481a75b39d371b39b25e3df6', 'id': 'f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'created_at': datetime.datetime(2026, 9, 28, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 31, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62/file', 'properties': {}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ebd58b-338b-41ed-918a-11da85802315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ebd58b-338b-41ed-918a-11da85802315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f9fe1f-f6e0-4c2f-8a24-63ea1ae9102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Volume 836125a9-868b-4b15-b5ac-107062749694: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-836125a9-868b-4b15-b5ac-107062749694', 'volume_size': 1, 'image_id': 'f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49dc2b8b7b1da8657a2c990a780f0a94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '839fa8e11f1e4993b356df88db3bef72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9de3463dac9666895c06e875b35918b371027b98c5651e21f2a26123990e45e5810bca8ef642f6aa3302335ccb33ef6eb727ab9481a75b39d371b39b25e3df6', 'id': 'f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'created_at': datetime.datetime(2026, 9, 28, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 31, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62/file', 'properties': {}}, 'image_service': } Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Trying to clone 836125a9-868b-4b15-b5ac-107062749694 from image f8c444e1-e913-449a-a7ef-1bfd5114cf62 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'metadata': {}}]). {{(pid=86981) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:31:04 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[41879400-e47b-4c06-8f3b-896d0380e215]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:04 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD Sep 28 18:31:04 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:04 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (cd69a2e2-8ea8-4757-8d89-cad74a67aaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43548312-d297-4544-aded-28ca3195c8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43548312-d297-4544-aded-28ca3195c8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467400073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892a2b2c-08a4-47d6-906b-d0f957fe1d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:05Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a400ba-eefa-4e78-a8d1-2f7ecccb4e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a400ba-eefa-4e78-a8d1-2f7ecccb4e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ea58e4-5413-4978-b4c8-adb2d7eeac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ea58e4-5413-4978-b4c8-adb2d7eeac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892a2b2c-08a4-47d6-906b-d0f957fe1d70', 'volume_name': 'volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f6cae8-6702-4846-9c45-488acca74334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f6cae8-6702-4846-9c45-488acca74334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6314da92-7483-4477-8a87-031a74391e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:05 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Volume 892a2b2c-08a4-47d6-906b-d0f957fe1d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70', 'volume_size': 1} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467400073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892a2b2c-08a4-47d6-906b-d0f957fe1d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:05Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Creating volume 892a2b2c-08a4-47d6-906b-d0f957fe1d70 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:05 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 1073741824 Sep 28 18:31:05 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:05 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD Sep 28 18:31:05 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:05 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Temporary image f8c444e1-e913-449a-a7ef-1bfd5114cf62 is fetched for user 37417d69a3fb4cc1bb4f7d9e59a97905. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8abcfb-503a-4860-84ba-dab09c4d1c5a]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 1073741824" returned: 0 in 0.693s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 Sep 28 18:31:05 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD Sep 28 18:31:06 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70" returned: 0 in 0.403s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:06 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6314da92-7483-4477-8a87-031a74391e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feb0ded-bdb4-4b3a-a9ea-20994716b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:06 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Volume volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 (892a2b2c-08a4-47d6-906b-d0f957fe1d70): created successfully Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feb0ded-bdb4-4b3a-a9ea-20994716b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (cd69a2e2-8ea8-4757-8d89-cad74a67aaaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:06 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e2906fbf-4693-4a53-87c9-b76987f2c5d1 tempest-ProjectReaderTests-74922425 None] Created volume successfully. Sep 28 18:31:06 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD Sep 28 18:31:06 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836125a9-868b-4b15-b5ac-107062749694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839fa8e11f1e4993b356df88db3bef72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:04Z,use_quota=True,user_id='37417d69a3fb4cc1bb4f7d9e59a97905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Creating volume 836125a9-868b-4b15-b5ac-107062749694 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:06 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:06 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 1073741824 Sep 28 18:31:06 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-892a2b2c-08a4-47d6-906b-d0f957fe1d70-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Lock "cinder-892a2b2c-08a4-47d6-906b-d0f957fe1d70-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-quobyte-892a2b2c-08a4-47d6-906b-d0f957fe1d70" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-892a2b2c-08a4-47d6-906b-d0f957fe1d70" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:07 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b953c-2949-4e4e-b166-7eea011aca3f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 1073741824" returned: 0 in 0.697s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:07 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 Sep 28 18:31:07 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:07 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 Sep 28 18:31:07 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:07 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694" returned: 0 in 0.372s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:07 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Attempting download of f8c444e1-e913-449a-a7ef-1bfd5114cf62 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'metadata': {}}])) to volume 836125a9-868b-4b15-b5ac-107062749694. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70" returned: 0 in 0.483s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:07 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70 Sep 28 18:31:07 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729fa0c-4df7-4b6e-b43f-f915359a3778]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c444e1-e913-449a-a7ef-1bfd5114cf62_3qkhfwfh {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:08 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c444e1-e913-449a-a7ef-1bfd5114cf62_3qkhfwfh Sep 28 18:31:08 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:08 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-892a2b2c-08a4-47d6-906b-d0f957fe1d70" returned: 0 in 0.309s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-892a2b2c-08a4-47d6-906b-d0f957fe1d70" released by "delete_volume" :: held 0.861s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Created reservations ['e3ee78a1-3b7f-4d1c-a3e7-7a530131073a', '430a8f6e-2082-4cd8-8ad6-2497888706aa', 'b43acc0e-425d-4788-b3ca-bd58689c6ca8', '2c8d3467-ec1f-443c-89b8-d45986037187'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:08 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c444e1-e913-449a-a7ef-1bfd5114cf62_3qkhfwfh" returned: 0 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c444e1-e913-449a-a7ef-1bfd5114cf62_3qkhfwfh {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:08 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:08 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:08 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c444e1-e913-449a-a7ef-1bfd5114cf62_3qkhfwfh Sep 28 18:31:08 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:08 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.368s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:08 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Deleted volume successfully. Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-79e6a169-377c-424c-80fc-43a8f2d521b8 tempest-ProjectReaderTests-74922425 None] Lock "cinder-892a2b2c-08a4-47d6-906b-d0f957fe1d70-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:08 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c444e1-e913-449a-a7ef-1bfd5114cf62_3qkhfwfh" returned: 1 in 0.500s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c444e1-e913-449a-a7ef-1bfd5114cf62_3qkhfwfh' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[13af65d6-8d17-4959-88b5-f5934985d5cd]: (4, 'raw') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD Sep 28 18:31:09 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (eb7a1cfd-6c29-4219-a114-a304b2cd2be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5e4f03-a598-4f29-a57c-f45e4db12b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5e4f03-a598-4f29-a57c-f45e4db12b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937025459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03a791a-e95e-4855-af0e-7f0bce1a55c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:09Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b1c317-f5b8-4eaf-b3e1-d32213eb520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b1c317-f5b8-4eaf-b3e1-d32213eb520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1f333f-6df9-4fa8-993a-3aba28aa0246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1f333f-6df9-4fa8-993a-3aba28aa0246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03a791a-e95e-4855-af0e-7f0bce1a55c6', 'volume_name': 'volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc47d33-d329-4e9d-ae07-f09a120e4f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc47d33-d329-4e9d-ae07-f09a120e4f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8c2d41-8d20-4a50-b731-1a60cfd44211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:09 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Volume b03a791a-e95e-4855-af0e-7f0bce1a55c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6', 'volume_size': 1} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937025459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03a791a-e95e-4855-af0e-7f0bce1a55c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:09Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Creating volume b03a791a-e95e-4855-af0e-7f0bce1a55c6 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:09 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 1073741824 Sep 28 18:31:09 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:09 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD Sep 28 18:31:09 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-3594e680-6c0b-4c6a-8c3b-41910aff4cdd tempest-ProjectAdminTests-927408481 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1100692749023, 'free_capacity_gb': 1775.1100692749023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86981) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:31:09 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD" returned: 1 in 0.504s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] f8c444e1-e913-449a-a7ef-1bfd5114cf62 was raw, converting to qcow2 {{(pid=86981) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:31:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 Sep 28 18:31:09 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:09 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 1073741824" returned: 0 in 0.794s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:10 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 Sep 28 18:31:10 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:10 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6" returned: 0 in 0.333s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8c2d41-8d20-4a50-b731-1a60cfd44211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af2e9a1-7e52-4ece-aca9-91fb40f759a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:10 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Volume volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 (b03a791a-e95e-4855-af0e-7f0bce1a55c6): created successfully Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af2e9a1-7e52-4ece-aca9-91fb40f759a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (eb7a1cfd-6c29-4219-a114-a304b2cd2be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:10 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0584cec4-7ad9-45dc-a228-2ab5842b7437 tempest-ProjectReaderTests-74922425 None] Created volume successfully. Sep 28 18:31:10 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694" returned: 0 in 0.713s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8c444e1-e913-449a-a7ef-1bfd5114cf62_c601_2ktdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:31:10 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:31:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:10 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 1G Sep 28 18:31:10 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:11 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 1G" returned: 0 in 0.402s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Downloaded image f8c444e1-e913-449a-a7ef-1bfd5114cf62 ((None, [{'url': 'file:///opt/stack/data/glance/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'metadata': {}}])) to volume 836125a9-868b-4b15-b5ac-107062749694 successfully. {{(pid=86981) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Temporary image f8c444e1-e913-449a-a7ef-1bfd5114cf62 for user 37417d69a3fb4cc1bb4f7d9e59a97905 is deleted. {{(pid=86981) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.volume_utils [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Marking volume 836125a9-868b-4b15-b5ac-107062749694 as bootable. {{(pid=86981) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Copying metadata from image f8c444e1-e913-449a-a7ef-1bfd5114cf62 to 836125a9-868b-4b15-b5ac-107062749694. {{(pid=86981) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Creating volume glance metadata for volume 836125a9-868b-4b15-b5ac-107062749694 backed by image f8c444e1-e913-449a-a7ef-1bfd5114cf62 with: {'image_id': 'f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '49dc2b8b7b1da8657a2c990a780f0a94', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86981) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f9fe1f-f6e0-4c2f-8a24-63ea1ae9102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836125a9-868b-4b15-b5ac-107062749694', 'volume_size': 1, 'image_id': 'f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49dc2b8b7b1da8657a2c990a780f0a94', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '839fa8e11f1e4993b356df88db3bef72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9de3463dac9666895c06e875b35918b371027b98c5651e21f2a26123990e45e5810bca8ef642f6aa3302335ccb33ef6eb727ab9481a75b39d371b39b25e3df6', 'id': 'f8c444e1-e913-449a-a7ef-1bfd5114cf62', 'created_at': datetime.datetime(2026, 9, 28, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 31, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c444e1-e913-449a-a7ef-1bfd5114cf62/file', 'properties': {}}, 'image_service': }' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb080457-20e8-464d-8345-1e02386406df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:11 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Volume volume-836125a9-868b-4b15-b5ac-107062749694 (836125a9-868b-4b15-b5ac-107062749694): created successfully Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb080457-20e8-464d-8345-1e02386406df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Flow 'volume_create_manager' (41c53b78-4b85-4478-9d31-99faaaedb159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-b03a791a-e95e-4855-af0e-7f0bce1a55c6-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c4a53674-b92e-400a-b5cf-8ee4ba485f7a tempest-VolumeImageDependencyTests-1212860004 None] Created volume successfully. Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Lock "cinder-b03a791a-e95e-4855-af0e-7f0bce1a55c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-quobyte-b03a791a-e95e-4855-af0e-7f0bce1a55c6" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-b03a791a-e95e-4855-af0e-7f0bce1a55c6" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b04fafc-2525-45e7-9e16-ae47825a6982]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:11 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 Sep 28 18:31:11 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Acquiring lock "cinder-836125a9-868b-4b15-b5ac-107062749694-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Lock "cinder-836125a9-868b-4b15-b5ac-107062749694-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Acquiring lock "cinder-quobyte-836125a9-868b-4b15-b5ac-107062749694" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Lock "cinder-quobyte-836125a9-868b-4b15-b5ac-107062749694" acquired by "delete_volume" :: waited 0.033s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0960c9-5ca2-4e92-951a-625885e98a07]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:12 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6" returned: 0 in 0.598s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:12 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6 Sep 28 18:31:12 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:12 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 Sep 28 18:31:12 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:12 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b03a791a-e95e-4855-af0e-7f0bce1a55c6" returned: 0 in 0.478s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-b03a791a-e95e-4855-af0e-7f0bce1a55c6" released by "delete_volume" :: held 1.146s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:12 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694" returned: 0 in 0.661s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:12 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694 Sep 28 18:31:12 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Created reservations ['ee7bbb72-e59f-48ea-9261-1239ce925475', 'a93d2d0f-c9f9-44a7-bd5f-b56ec234dfd1', '0c11d7ac-a304-41bf-a722-000a5994bdb3', 'c3d9f6f6-1159-41fd-93a8-6d6834aab3f2'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:12 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:12 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:13 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-836125a9-868b-4b15-b5ac-107062749694" returned: 0 in 0.448s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Lock "cinder-quobyte-836125a9-868b-4b15-b5ac-107062749694" released by "delete_volume" :: held 1.192s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Created reservations ['6bc23306-af7d-4e16-825e-d6ee34226eb3', 'b92e1765-c3c4-48fe-b53f-4bfd7376a8cc', '393013bb-14e0-480a-a6fa-1b5827cbbb27', 'd97f7bc6-1ec4-4762-b7c6-1a3bba750632'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:13 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.439s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Deleted volume successfully. Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2a6b014e-89c0-4303-a17c-73ce481cf7b9 tempest-ProjectReaderTests-74922425 None] Lock "cinder-b03a791a-e95e-4855-af0e-7f0bce1a55c6-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:13 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:13 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:13 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.406s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Deleted volume successfully. Sep 28 18:31:13 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-c92ed176-c3b2-4109-8bfa-efb6a26712c2 tempest-VolumeImageDependencyTests-1212860004 None] Lock "cinder-836125a9-868b-4b15-b5ac-107062749694-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (11cb7fa4-0cc5-425a-ba67-14b9cd53c658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb9291-f4d7-4d70-8651-6af24189de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb9291-f4d7-4d70-8651-6af24189de3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746635772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddace9df-8984-403f-b6b9-acd161e46008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:14Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476bc320-72dc-4680-852b-a0b00b92ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476bc320-72dc-4680-852b-a0b00b92ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39a4ad8-fe28-4267-8f28-84d2029a6faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39a4ad8-fe28-4267-8f28-84d2029a6faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddace9df-8984-403f-b6b9-acd161e46008', 'volume_name': 'volume-ddace9df-8984-403f-b6b9-acd161e46008', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ac80cd-b10c-4b85-b45f-3071299bdee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ac80cd-b10c-4b85-b45f-3071299bdee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0135741-7136-4d7b-8f33-a1e52f8b461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:14 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Volume ddace9df-8984-403f-b6b9-acd161e46008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddace9df-8984-403f-b6b9-acd161e46008', 'volume_size': 1} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746635772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddace9df-8984-403f-b6b9-acd161e46008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79380fa3da25414d9b5890f06e2bdc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:14Z,use_quota=True,user_id='e0292fb677874f1e92ec26f1df249d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Creating volume ddace9df-8984-403f-b6b9-acd161e46008 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:14 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:14 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 1073741824 Sep 28 18:31:14 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:15 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 1073741824" returned: 0 in 0.671s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:15 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 Sep 28 18:31:15 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:15 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008" returned: 0 in 0.427s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0135741-7136-4d7b-8f33-a1e52f8b461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddace9df-8984-403f-b6b9-acd161e46008', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1949826-103f-4030-b797-b9e07a7ca35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:15 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Volume volume-ddace9df-8984-403f-b6b9-acd161e46008 (ddace9df-8984-403f-b6b9-acd161e46008): created successfully Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1949826-103f-4030-b797-b9e07a7ca35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Flow 'volume_create_manager' (11cb7fa4-0cc5-425a-ba67-14b9cd53c658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9d31d9c9-5b48-47f4-8833-cfff25ce5c0b tempest-ProjectReaderTests-74922425 None] Created volume successfully. Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (9cda52bb-7038-40dc-963e-e9feed646d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5635ca0a-145e-43e9-8f8d-9be7d8579f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5635ca0a-145e-43e9-8f8d-9be7d8579f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491654537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad4c902-9a76-487e-b708-8b9ed7855673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:16Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f476b63e-ea3a-47b1-9c67-6aad896e373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f476b63e-ea3a-47b1-9c67-6aad896e373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207ebbae-eb4d-4948-860e-0a3df177a669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207ebbae-eb4d-4948-860e-0a3df177a669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad4c902-9a76-487e-b708-8b9ed7855673', 'volume_name': 'volume-5ad4c902-9a76-487e-b708-8b9ed7855673', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d52361b-d540-4503-ae94-7ec6e3ade7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d52361b-d540-4503-ae94-7ec6e3ade7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4e11a1-f2a5-45bf-a236-a0c0d9092e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:16 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Volume 5ad4c902-9a76-487e-b708-8b9ed7855673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad4c902-9a76-487e-b708-8b9ed7855673', 'volume_size': 1} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491654537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad4c902-9a76-487e-b708-8b9ed7855673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:16Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Creating volume 5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:16 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:16 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 1073741824 Sep 28 18:31:16 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-ddace9df-8984-403f-b6b9-acd161e46008-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Lock "cinder-ddace9df-8984-403f-b6b9-acd161e46008-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Acquiring lock "cinder-quobyte-ddace9df-8984-403f-b6b9-acd161e46008" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-ddace9df-8984-403f-b6b9-acd161e46008" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cafec2-0450-4d67-b2ce-fe12486b385d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:17 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 1073741824" returned: 0 in 0.684s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:17 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 Sep 28 18:31:17 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:17 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 Sep 28 18:31:17 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:17 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673" returned: 0 in 0.437s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:17 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008" returned: 0 in 0.629s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4e11a1-f2a5-45bf-a236-a0c0d9092e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad4c902-9a76-487e-b708-8b9ed7855673', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:17 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008 Sep 28 18:31:17 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614fdd53-dacb-4d24-af33-f53fd32dbe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:17 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Volume volume-5ad4c902-9a76-487e-b708-8b9ed7855673 (5ad4c902-9a76-487e-b708-8b9ed7855673): created successfully Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614fdd53-dacb-4d24-af33-f53fd32dbe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (9cda52bb-7038-40dc-963e-e9feed646d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:17 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-40fce1ba-67a3-4fc5-ac19-500de2393326 tempest-ProjectReaderTests-1721266977 None] Created volume successfully. Sep 28 18:31:17 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ddace9df-8984-403f-b6b9-acd161e46008" returned: 0 in 0.442s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Lock "cinder-quobyte-ddace9df-8984-403f-b6b9-acd161e46008" released by "delete_volume" :: held 1.139s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Created reservations ['1cb43f99-6678-4d2a-82bb-00b0813e99df', '4219471f-6e38-4e4e-99ed-f9be5cda307b', 'ac3e079c-91ff-475c-a86b-21cffdc0daca', 'c30d1cb8-0288-409a-b40d-af23f0c5978c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:18 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:18 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Creating offline snapshot fd9d10ba-77f7-42e9-8ab0-4e481130bd5b of volume 5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:18 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.441s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Deleted volume successfully. Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf16693-d309-438b-a6e4-ea5a7cfc5b37]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d1cb3b24-cb70-4eab-8acc-459ab68bf12c tempest-ProjectReaderTests-74922425 None] Lock "cinder-ddace9df-8984-403f-b6b9-acd161e46008-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:18 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 Sep 28 18:31:18 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:19 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673" returned: 0 in 0.573s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:19 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b 1G Sep 28 18:31:19 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Flow 'volume_create_manager' (109437c4-26f9-4eb6-ab82-a0634fd10a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0247d6d3-b28b-4ef7-9b3f-3552c0840eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0247d6d3-b28b-4ef7-9b3f-3552c0840eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415134ea-5107-4798-80ef-1b21a6f9e65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc302069a09497fb1983d53ec5fce3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:19Z,use_quota=True,user_id='07711913548a44759dee342229157543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef58b130-5943-4208-afa7-21c938a4b970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef58b130-5943-4208-afa7-21c938a4b970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219d808b-be37-402b-b4f4-d2748e0de9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219d808b-be37-402b-b4f4-d2748e0de9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415134ea-5107-4798-80ef-1b21a6f9e65d', 'volume_name': 'volume-415134ea-5107-4798-80ef-1b21a6f9e65d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba52758-804a-4367-a2db-e3a26977b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba52758-804a-4367-a2db-e3a26977b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9deb117-02ae-4e2a-bed6-13c4a9cd433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Volume 415134ea-5107-4798-80ef-1b21a6f9e65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415134ea-5107-4798-80ef-1b21a6f9e65d', 'volume_size': 1} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Flow 'volume_create_manager' (573f8ebd-58a6-4c30-80c9-e82ade9b435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:19 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d60700-18f8-4874-b2b5-9e4180786d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b 1G" returned: 0 in 0.569s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad4c902-9a76-487e-b708-8b9ed7855673 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:19 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad4c902-9a76-487e-b708-8b9ed7855673 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d60700-18f8-4874-b2b5-9e4180786d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1556799329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17280e6060148f58219fa6e2543f1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:20Z,use_quota=True,user_id='4961b6191001487f9d6e0030598a7875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d576ad61-aca1-4fd9-a3d6-f4b624fc3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d576ad61-aca1-4fd9-a3d6-f4b624fc3abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f5b1a2-de23-4951-a026-ee680ecbc686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f5b1a2-de23-4951-a026-ee680ecbc686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0', 'volume_name': 'volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1597612e-7a4d-4205-bcb1-846a5285bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1597612e-7a4d-4205-bcb1-846a5285bd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a16846d-7c65-4f0d-8cf8-28ab64b2f971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Volume 6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0', 'volume_size': 1} Sep 28 18:31:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:20 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ad4c902-9a76-487e-b708-8b9ed7855673 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" returned: 0 in 0.323s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:20 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b is being set with open permissions: ugo+rw Sep 28 18:31:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:20 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b Sep 28 18:31:20 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:20 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" returned: 0 in 0.293s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:20 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.info Sep 28 18:31:20 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:20 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.info" returned: 0 in 0.289s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:20 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.info is being set with open permissions: ugo+rw Sep 28 18:31:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:20 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.info Sep 28 18:31:20 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:21 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.info" returned: 0 in 0.283s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415134ea-5107-4798-80ef-1b21a6f9e65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc302069a09497fb1983d53ec5fce3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:19Z,use_quota=True,user_id='07711913548a44759dee342229157543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Creating volume 415134ea-5107-4798-80ef-1b21a6f9e65d {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:21 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:21 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d 1073741824 Sep 28 18:31:21 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:21 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-43eb415a-5b77-4ea0-ba3d-1cb5ae8a287e tempest-ProjectReaderTests-1721266977 None] Create snapshot completed successfully Sep 28 18:31:21 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d 1073741824" returned: 0 in 0.481s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:21 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d Sep 28 18:31:21 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:21 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d" returned: 0 in 0.265s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1556799329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17280e6060148f58219fa6e2543f1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:20Z,use_quota=True,user_id='4961b6191001487f9d6e0030598a7875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Creating volume 6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:21 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:21 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 1073741824 Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9deb117-02ae-4e2a-bed6-13c4a9cd433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415134ea-5107-4798-80ef-1b21a6f9e65d', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:21 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:21 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab43af6-5855-4ab3-bca0-136316db2408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:21 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Volume volume-415134ea-5107-4798-80ef-1b21a6f9e65d (415134ea-5107-4798-80ef-1b21a6f9e65d): created successfully Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab43af6-5855-4ab3-bca0-136316db2408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Flow 'volume_create_manager' (109437c4-26f9-4eb6-ab82-a0634fd10a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-739b7a2f-3585-4b8e-890c-ee57872302c0 tempest-CinderUnicodeTest-1792196699 None] Created volume successfully. Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-fd9d10ba-77f7-42e9-8ab0-4e481130bd5b-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-fd9d10ba-77f7-42e9-8ab0-4e481130bd5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-5ad4c902-9a76-487e-b708-8b9ed7855673" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5ad4c902-9a76-487e-b708-8b9ed7855673" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Deleting offline snapshot fd9d10ba-77f7-42e9-8ab0-4e481130bd5b of volume 5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] snapshot_file for this snap is: volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc5e29a-a4b0-4a6b-b116-f5a30b99b383]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:22 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b Sep 28 18:31:22 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:22 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 1073741824" returned: 0 in 0.563s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:22 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 Sep 28 18:31:22 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:22 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" returned: 0 in 0.458s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ad4c902-9a76-487e-b708-8b9ed7855673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf06161-9760-4716-ae0b-713dfb6c9eb6]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:22 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" returned: 0 in 0.304s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a16846d-7c65-4f0d-8cf8-28ab64b2f971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6b276d-6b79-438a-8d88-b385abc6fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:22 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Volume volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 (6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0): created successfully Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6b276d-6b79-438a-8d88-b385abc6fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:22 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Flow 'volume_create_manager' (573f8ebd-58a6-4c30-80c9-e82ade9b435c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-72512529-d474-42c4-8d03-fe045e889553 tempest-SnapshotDependencyTests-947627282 None] Created volume successfully. Sep 28 18:31:22 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 Sep 28 18:31:22 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Flow 'volume_create_manager' (f5d1e135-cf8d-4ba6-a3d8-188057524179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6887e778-d11c-4c2b-9ef8-e6271c0d040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6887e778-d11c-4c2b-9ef8-e6271c0d040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-409184731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c821442-8651-430f-80f3-1dfefd868587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc302069a09497fb1983d53ec5fce3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:23Z,use_quota=True,user_id='07711913548a44759dee342229157543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94441c5a-ea40-4b4b-bade-381f727514ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94441c5a-ea40-4b4b-bade-381f727514ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4361b110-78d0-43b7-a956-9a7876724e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4361b110-78d0-43b7-a956-9a7876724e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c821442-8651-430f-80f3-1dfefd868587', 'volume_name': 'volume-1c821442-8651-430f-80f3-1dfefd868587', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9684e9-bbc3-4918-8d34-a6df470146fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9684e9-bbc3-4918-8d34-a6df470146fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc73d5-438a-4755-97be-b21b7a89ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:23 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Volume 1c821442-8651-430f-80f3-1dfefd868587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c821442-8651-430f-80f3-1dfefd868587', 'volume_size': 1} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-409184731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c821442-8651-430f-80f3-1dfefd868587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc302069a09497fb1983d53ec5fce3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:23Z,use_quota=True,user_id='07711913548a44759dee342229157543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Creating volume 1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:23 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:23 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 1073741824 Sep 28 18:31:23 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:23 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673" returned: 0 in 0.465s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:23 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b Sep 28 18:31:23 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:23 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" returned: 0 in 0.358s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:23 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b Sep 28 18:31:23 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:23 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 1073741824" returned: 0 in 0.468s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:23 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 Sep 28 18:31:23 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:23 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673.fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" returned: 0 in 0.256s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-fd9d10ba-77f7-42e9-8ab0-4e481130bd5b" released by "_delete_snapshot" :: held 1.670s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5ad4c902-9a76-487e-b708-8b9ed7855673" released by "delete_snapshot" :: held 1.703s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:24 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587" returned: 0 in 0.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc73d5-438a-4755-97be-b21b7a89ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c821442-8651-430f-80f3-1dfefd868587', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476203d8-baa8-4686-9393-03fbc4901446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:24 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Volume volume-1c821442-8651-430f-80f3-1dfefd868587 (1c821442-8651-430f-80f3-1dfefd868587): created successfully Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476203d8-baa8-4686-9393-03fbc4901446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Flow 'volume_create_manager' (f5d1e135-cf8d-4ba6-a3d8-188057524179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Created reservations ['a5cfbf1e-7fd4-4fca-ae8f-bb004034a08c', '3cdd83fd-a5c2-4d6a-ac14-420a36cca5ff', '729eae47-f7c1-4ede-b29e-794830a7be7e', 'a9338ce9-64ff-4e7e-bce3-5e5701a9175c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:24 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0bd1e558-b273-40ea-88a7-5f0a6432ba1d tempest-CinderUnicodeTest-1792196699 None] Created volume successfully. Sep 28 18:31:24 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Delete snapshot completed successfully. Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-eb843f8a-edb5-4f9c-9a17-250e088b9730 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-fd9d10ba-77f7-42e9-8ab0-4e481130bd5b-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Creating offline snapshot 788bb780-82ea-4489-a2b4-20c2af2410c5 of volume 6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b38e2b-988f-432d-a864-bf5ce50a5311]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-5ad4c902-9a76-487e-b708-8b9ed7855673-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Lock "cinder-5ad4c902-9a76-487e-b708-8b9ed7855673-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-5ad4c902-9a76-487e-b708-8b9ed7855673" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5ad4c902-9a76-487e-b708-8b9ed7855673" acquired by "delete_volume" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:24 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[39912201-cfb8-489a-91be-53aeac5c4820]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:24 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:24 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 Sep 28 18:31:24 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:24 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" returned: 0 in 0.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:24 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 1G Sep 28 18:31:24 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:24 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673" returned: 0 in 0.394s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:24 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673 Sep 28 18:31:24 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:25 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5ad4c902-9a76-487e-b708-8b9ed7855673" returned: 0 in 0.290s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5ad4c902-9a76-487e-b708-8b9ed7855673" released by "delete_volume" :: held 0.752s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:25 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Created reservations ['88fc2b0d-0236-46b9-a950-8c044130f7a8', 'b9bdca46-c291-40ed-9390-b5648326e470', '6ab2bc2a-4cf8-48d4-b75b-e5809565092e', '8bca8286-6ca7-4d2f-a686-d25405146578'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 1G" returned: 0 in 0.516s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:25 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 Sep 28 18:31:25 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:25 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:25 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:25 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5" returned: 0 in 0.383s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:25 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 is being set with open permissions: ugo+rw Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:25 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 Sep 28 18:31:25 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:25 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.334s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Deleted volume successfully. Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-48ceac61-c016-4bbb-ba63-5bd48282bfbe tempest-ProjectReaderTests-1721266977 None] Lock "cinder-5ad4c902-9a76-487e-b708-8b9ed7855673-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:25 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5" returned: 0 in 0.291s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:26 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.info Sep 28 18:31:26 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (98e5cc83-5b14-4af0-8935-00ff4726bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fc7fe3-03f8-4693-b30a-a9ee9d6d4222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fc7fe3-03f8-4693-b30a-a9ee9d6d4222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1753370953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bd694b-2d53-4c92-a407-4f737a73f153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:26Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d04391a-587a-400f-850d-7cdb128388e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d04391a-587a-400f-850d-7cdb128388e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafb7ddc-39b6-4925-bdb1-b3db852f3c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafb7ddc-39b6-4925-bdb1-b3db852f3c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bd694b-2d53-4c92-a407-4f737a73f153', 'volume_name': 'volume-a3bd694b-2d53-4c92-a407-4f737a73f153', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc724a45-bf02-49a5-87c0-5e0b8f6c47f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc724a45-bf02-49a5-87c0-5e0b8f6c47f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f3c525-7619-4b76-8f3b-f8a482eea705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:26 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Volume a3bd694b-2d53-4c92-a407-4f737a73f153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bd694b-2d53-4c92-a407-4f737a73f153', 'volume_size': 1} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:26 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.info" returned: 0 in 0.325s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:26 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.info is being set with open permissions: ugo+rw Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:26 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.info Sep 28 18:31:26 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:26 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.info" returned: 0 in 0.253s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.045s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Creating offline snapshot 63c1c19f-6d06-4c90-8726-178a503888ef of volume 1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:26 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-1d014cc5-9d27-4db4-aff0-c1373b18302c tempest-SnapshotDependencyTests-947627282 None] Create snapshot completed successfully Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a207e588-0725-4379-b6e3-2992c74e5abe]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:26 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 Sep 28 18:31:26 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:27 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:27 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef 1G Sep 28 18:31:27 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:27 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef 1G" returned: 0 in 0.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c821442-8651-430f-80f3-1dfefd868587 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:27 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c821442-8651-430f-80f3-1dfefd868587 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef Sep 28 18:31:27 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:27 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c821442-8651-430f-80f3-1dfefd868587 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef" returned: 0 in 0.310s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:27 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef is being set with open permissions: ugo+rw Sep 28 18:31:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:27 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef Sep 28 18:31:27 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:28 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef" returned: 0 in 0.278s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:28 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.info Sep 28 18:31:28 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Flow 'volume_create_manager' (6cb0eb9d-203f-460a-9ecf-e1f3ffef2591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a1aba3-3945-4375-b110-76636bda6429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a1aba3-3945-4375-b110-76636bda6429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da21ad4d-8d60-48ba-8a7a-e6996edbf816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b17280e6060148f58219fa6e2543f1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=788bb780-82ea-4489-a2b4-20c2af2410c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:28Z,use_quota=True,user_id='4961b6191001487f9d6e0030598a7875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0a9a79-37a4-4a73-8d4b-fe5c9ab2d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0a9a79-37a4-4a73-8d4b-fe5c9ab2d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee85328-57c4-45a2-af2f-8abad914fb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee85328-57c4-45a2-af2f-8abad914fb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da21ad4d-8d60-48ba-8a7a-e6996edbf816', 'volume_name': 'volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816', 'volume_size': 1, 'snapshot_id': '788bb780-82ea-4489-a2b4-20c2af2410c5'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9eabba-cf15-4a26-b648-8727ac21cbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9eabba-cf15-4a26-b648-8727ac21cbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb560ba-8940-4179-b4bc-5180ba0037ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Volume da21ad4d-8d60-48ba-8a7a-e6996edbf816: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816', 'volume_size': 1, 'snapshot_id': '788bb780-82ea-4489-a2b4-20c2af2410c5'} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:28 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.info" returned: 0 in 0.308s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:28 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.info is being set with open permissions: ugo+rw Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:28 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.info Sep 28 18:31:28 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:28 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.info" returned: 0 in 0.282s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.383s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1753370953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bd694b-2d53-4c92-a407-4f737a73f153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:26Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Creating volume a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:28 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:28 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 1073741824 Sep 28 18:31:28 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5cf5d05d-dd9b-494c-9b06-915ecab867fd tempest-CinderUnicodeTest-1792196699 None] Create snapshot completed successfully Sep 28 18:31:29 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 1073741824" returned: 0 in 0.442s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:29 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 Sep 28 18:31:29 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:29 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153" returned: 0 in 0.255s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.061s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-quobyte-788bb780-82ea-4489-a2b4-20c2af2410c5-da21ad4d-8d60-48ba-8a7a-e6996edbf816" by "_create_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f3c525-7619-4b76-8f3b-f8a482eea705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bd694b-2d53-4c92-a407-4f737a73f153', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c15baac-c689-421e-aa46-a4af667e9de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-788bb780-82ea-4489-a2b4-20c2af2410c5-da21ad4d-8d60-48ba-8a7a-e6996edbf816" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Creating volume da21ad4d-8d60-48ba-8a7a-e6996edbf816 from snapshot 788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-quobyte-da21ad4d-8d60-48ba-8a7a-e6996edbf816" by "_copy_volume_from_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-da21ad4d-8d60-48ba-8a7a-e6996edbf816" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] snapshot: 788bb780-82ea-4489-a2b4-20c2af2410c5, volume: da21ad4d-8d60-48ba-8a7a-e6996edbf816, {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:31:29 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Volume volume-a3bd694b-2d53-4c92-a407-4f737a73f153 (a3bd694b-2d53-4c92-a407-4f737a73f153): created successfully Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c15baac-c689-421e-aa46-a4af667e9de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (98e5cc83-5b14-4af0-8935-00ff4726bc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8bbb74-cabf-44aa-a2a6-acd890e41e08]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:29 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-540fcbaa-f122-43a7-9ff8-c03dc5d245d3 tempest-ProjectReaderTests-1721266977 None] Created volume successfully. Sep 28 18:31:29 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 Sep 28 18:31:29 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "cinder-63c1c19f-6d06-4c90-8726-178a503888ef-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-63c1c19f-6d06-4c90-8726-178a503888ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "cinder-quobyte-1c821442-8651-430f-80f3-1dfefd868587" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-1c821442-8651-430f-80f3-1dfefd868587" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "cinder-quobyte-63c1c19f-6d06-4c90-8726-178a503888ef" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-63c1c19f-6d06-4c90-8726-178a503888ef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Deleting offline snapshot 63c1c19f-6d06-4c90-8726-178a503888ef of volume 1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] snapshot_file for this snap is: volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20df568-575c-4aa0-acea-a476b68a89d8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:29 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5" returned: 0 in 0.396s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[c754f182-c55c-4693-a155-b677fe1b0fc2]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:29 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:30 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef Sep 28 18:31:30 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:30 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 Sep 28 18:31:30 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:30 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef" returned: 0 in 0.431s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c821442-8651-430f-80f3-1dfefd868587(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a2fc6c-b258-46f8-818f-2a9348db4bb3]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:30 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" returned: 0 in 0.425s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Creating direct copy from snapshot {{(pid=86981) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG cinder.utils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Path /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 not found in is_blk_device check {{(pid=86981) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:30 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 Sep 28 18:31:30 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:30 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 Sep 28 18:31:30 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:30 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587" returned: 0 in 0.408s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:30 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef Sep 28 18:31:30 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:31 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef" returned: 0 in 0.583s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:31 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef Sep 28 18:31:31 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:32 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587.63c1c19f-6d06-4c90-8726-178a503888ef" returned: 0 in 0.677s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-63c1c19f-6d06-4c90-8726-178a503888ef" released by "_delete_snapshot" :: held 2.307s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-1c821442-8651-430f-80f3-1dfefd868587" released by "delete_snapshot" :: held 2.337s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:32 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Created reservations ['ef8ab59e-17ca-454e-b29c-1e1242acf178', '5832a29c-4e96-4718-a4db-ee285043468f', '7b0a27f0-8a83-45c1-b447-6effd65a3d82', 'cdcda0b7-7600-48eb-ad33-75ec042b17a2'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:32 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Delete snapshot completed successfully. Sep 28 18:31:32 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8dd86cc9-f0a6-4e7e-bbf8-9f3da076a76b tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-63c1c19f-6d06-4c90-8726-178a503888ef-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "cinder-1c821442-8651-430f-80f3-1dfefd868587-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-1c821442-8651-430f-80f3-1dfefd868587-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "cinder-quobyte-1c821442-8651-430f-80f3-1dfefd868587" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-1c821442-8651-430f-80f3-1dfefd868587" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a4b2bc-ea6f-4ffd-8e74-ec383d2513d8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:33 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 Sep 28 18:31:33 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:33 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587" returned: 0 in 0.549s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:33 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587 Sep 28 18:31:33 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:34 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1c821442-8651-430f-80f3-1dfefd868587" returned: 0 in 0.334s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-1c821442-8651-430f-80f3-1dfefd868587" released by "delete_volume" :: held 1.064s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Created reservations ['98c559e9-7f94-43c5-9450-6eaca5945c75', '69aa95f8-d032-4b21-9809-376aab4a7fdf', '2c6c1764-525d-49aa-aa11-87c67f30b2d0', 'c23c9dde-e09f-49d9-b965-a4636585ed2c'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:34 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:34 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:34 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.356s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:34 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Deleted volume successfully. Sep 28 18:31:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-09406a67-3a04-4c29-afde-cd3eb399a4a3 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-1c821442-8651-430f-80f3-1dfefd868587-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "cinder-415134ea-5107-4798-80ef-1b21a6f9e65d-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-415134ea-5107-4798-80ef-1b21a6f9e65d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "cinder-quobyte-415134ea-5107-4798-80ef-1b21a6f9e65d" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-415134ea-5107-4798-80ef-1b21a6f9e65d" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:35 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eac3b4c-1872-4803-bbe4-d40a1bcd0a5b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:35 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d Sep 28 18:31:35 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:36 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d" returned: 0 in 0.637s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:36 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d Sep 28 18:31:36 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:36 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-415134ea-5107-4798-80ef-1b21a6f9e65d" returned: 0 in 0.412s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-quobyte-415134ea-5107-4798-80ef-1b21a6f9e65d" released by "delete_volume" :: held 1.132s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:36 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Created reservations ['eb61b672-897f-45c8-971a-01c69af6636c', '46bfa78b-c916-47e4-a085-5687771bff34', 'd2560247-6bd0-4202-8132-91eb2abc63e8', '1374af1a-725c-4b68-b276-a5c6460d7a3e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:37 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:37 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:37 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816" returned: 0 in 6.751s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.image.image_utils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 {{(pid=86981) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:31:37 devstack cinder-volume[86981]: INFO cinder.image.image_utils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Converted 1024.00 MB image at 151.65 MB/s Sep 28 18:31:37 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 is being set with open permissions: ugo+rw Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:37 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 Sep 28 18:31:37 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:37 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.296s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Deleted volume successfully. Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a8253a88-bcd0-48f7-835b-b57b2d757e50 tempest-CinderUnicodeTest-1792196699 None] Lock "cinder-415134ea-5107-4798-80ef-1b21a6f9e65d-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:37 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816" returned: 0 in 0.248s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-da21ad4d-8d60-48ba-8a7a-e6996edbf816" released by "_copy_volume_from_snapshot" :: held 7.937s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-788bb780-82ea-4489-a2b4-20c2af2410c5-da21ad4d-8d60-48ba-8a7a-e6996edbf816" released by "_create_volume_from_snapshot" :: held 8.003s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.038s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.863s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Creating offline snapshot 60056a48-04b0-4d20-9142-62f7803575bc of volume a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb560ba-8940-4179-b4bc-5180ba0037ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816', 'volume_size': 1, 'snapshot_id': '788bb780-82ea-4489-a2b4-20c2af2410c5'}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668c620f-599e-4bdf-ad8a-08f2c8a7ccaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[97088f1d-9fa8-4f4c-a69c-acb6c033a9b9]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:37 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Volume volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 (da21ad4d-8d60-48ba-8a7a-e6996edbf816): created successfully Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668c620f-599e-4bdf-ad8a-08f2c8a7ccaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Flow 'volume_create_manager' (6cb0eb9d-203f-460a-9ecf-e1f3ffef2591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:37 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-4d7f834d-aedb-491d-af17-dce00bb69f6e tempest-SnapshotDependencyTests-947627282 None] Created volume successfully. Sep 28 18:31:37 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 Sep 28 18:31:37 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:37 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153" returned: 0 in 0.395s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:37 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc 1G Sep 28 18:31:37 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-788bb780-82ea-4489-a2b4-20c2af2410c5-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-788bb780-82ea-4489-a2b4-20c2af2410c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-quobyte-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-quobyte-788bb780-82ea-4489-a2b4-20c2af2410c5" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-788bb780-82ea-4489-a2b4-20c2af2410c5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Deleting offline snapshot 788bb780-82ea-4489-a2b4-20c2af2410c5 of volume 6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] snapshot_file for this snap is: volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbdcaad-f42b-4a4d-913a-f4e4a579eba7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:38 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 Sep 28 18:31:38 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:38 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc 1G" returned: 0 in 0.612s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bd694b-2d53-4c92-a407-4f737a73f153 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:38 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bd694b-2d53-4c92-a407-4f737a73f153 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc Sep 28 18:31:38 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:38 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5" returned: 0 in 0.409s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abafe74-a118-40f8-a904-8235b818609c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:38 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:38 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:38 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 Sep 28 18:31:38 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:38 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bd694b-2d53-4c92-a407-4f737a73f153 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc" returned: 0 in 0.370s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:38 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc is being set with open permissions: ugo+rw Sep 28 18:31:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:38 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc Sep 28 18:31:38 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:39 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.297s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:31:39 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc" returned: 0 in 0.294s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:39 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.info Sep 28 18:31:39 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:39 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" returned: 0 in 0.634s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:39 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 Sep 28 18:31:39 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:39 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.info" returned: 0 in 0.314s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:39 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.info is being set with open permissions: ugo+rw Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:39 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.info Sep 28 18:31:39 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:39 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5" returned: 0 in 0.369s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:39 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5 Sep 28 18:31:39 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:39 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.info" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:39 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-16830d40-079a-47f0-8da1-a5fb438ecbde tempest-ProjectReaderTests-1721266977 None] Create snapshot completed successfully Sep 28 18:31:40 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0.788bb780-82ea-4489-a2b4-20c2af2410c5" returned: 0 in 0.287s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-60056a48-04b0-4d20-9142-62f7803575bc-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-788bb780-82ea-4489-a2b4-20c2af2410c5" released by "_delete_snapshot" :: held 1.864s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" released by "delete_snapshot" :: held 1.904s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-60056a48-04b0-4d20-9142-62f7803575bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-a3bd694b-2d53-4c92-a407-4f737a73f153" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-a3bd694b-2d53-4c92-a407-4f737a73f153" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-60056a48-04b0-4d20-9142-62f7803575bc" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-60056a48-04b0-4d20-9142-62f7803575bc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Deleting offline snapshot 60056a48-04b0-4d20-9142-62f7803575bc of volume a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] snapshot_file for this snap is: volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[80716fc4-45c7-4ee7-b502-43553fdeed63]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Created reservations ['44ef26a9-c4f5-4978-97d4-8dfa6b8f56b5', 'dce90471-4ecd-4332-a59a-ca845ad8c5bb', 'f2d33dec-ad1c-455c-a128-5d5f4e2a4e13', '92961ec4-4c41-43ac-a1d6-36ad5a9df42b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Delete snapshot completed successfully. Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83aae652-89be-4dad-ac6f-be9ec7b795a3 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-788bb780-82ea-4489-a2b4-20c2af2410c5-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:40 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc Sep 28 18:31:40 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:40 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc" returned: 0 in 0.437s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3bd694b-2d53-4c92-a407-4f737a73f153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51bac20-8ccf-4f3e-a706-9ba33b42246c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:40 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 Sep 28 18:31:40 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:41 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:41 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc Sep 28 18:31:41 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-quobyte-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[0408b835-eeba-4c14-9709-93a0db346e6d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:41 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc" returned: 0 in 0.501s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:41 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc Sep 28 18:31:41 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:41 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 Sep 28 18:31:41 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:41 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153.60056a48-04b0-4d20-9142-62f7803575bc" returned: 0 in 0.298s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:41 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-60056a48-04b0-4d20-9142-62f7803575bc" released by "_delete_snapshot" :: held 1.773s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-a3bd694b-2d53-4c92-a407-4f737a73f153" released by "delete_snapshot" :: held 1.803s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:42 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Created reservations ['d7b28db9-6852-4a6d-aea8-9e1ab7f9a45a', '8a23cd89-de74-4c5d-a53d-b7ba736e05cf', 'b5320368-e37a-4b0d-96f1-1adc4f1dee0f', '62f970c9-d6fd-4e80-a7be-c0fe68c7d83a'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" returned: 0 in 0.467s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:42 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0 Sep 28 18:31:42 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Delete snapshot completed successfully. Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-056293f8-e8ba-4a20-9858-38bd1f8ec489 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-60056a48-04b0-4d20-9142-62f7803575bc-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-a3bd694b-2d53-4c92-a407-4f737a73f153-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Lock "cinder-a3bd694b-2d53-4c92-a407-4f737a73f153-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-a3bd694b-2d53-4c92-a407-4f737a73f153" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:42 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" returned: 0 in 0.352s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-a3bd694b-2d53-4c92-a407-4f737a73f153" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0" released by "delete_volume" :: held 0.939s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba8f08-cf21-4bd4-a57a-68f690db8284]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Created reservations ['4204f2d1-22eb-46e8-afbe-2a9aaa913b2f', '281b4703-3e58-4f0e-bfd9-914493b5ac16', '00d631e6-3ddc-4203-b258-4eab714b8045', 'b2fd0752-6228-46dc-86a7-ac427d36f6d2'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:42 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 Sep 28 18:31:42 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-da21ad4d-8d60-48ba-8a7a-e6996edbf816-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:42 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:42 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-da21ad4d-8d60-48ba-8a7a-e6996edbf816-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "cinder-quobyte-da21ad4d-8d60-48ba-8a7a-e6996edbf816" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-da21ad4d-8d60-48ba-8a7a-e6996edbf816" acquired by "delete_volume" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc14cbec-58d9-4c03-90dd-b8cbcfaba904]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:43 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153" returned: 0 in 0.529s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:43 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 Sep 28 18:31:43 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:43 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.366s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:43 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153 Sep 28 18:31:43 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Deleted volume successfully. Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3d4fa36f-a9d6-417f-a62d-759b1f36cc54 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-6b9d611a-9be3-46d5-9ecd-b5d2a648d9c0-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:43 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-a3bd694b-2d53-4c92-a407-4f737a73f153" returned: 0 in 0.310s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-a3bd694b-2d53-4c92-a407-4f737a73f153" released by "delete_volume" :: held 0.911s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:43 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816" returned: 0 in 0.473s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:43 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816 Sep 28 18:31:43 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Created reservations ['f858c813-ef66-48ac-8a0b-6f4c3423e513', '9794c5cf-bef7-4145-8b2b-c5d5c9cf1d36', '2329664d-5aad-4695-a518-b3ea200221a6', 'f0c3e43c-74ad-4f60-ad10-0197507bdc22'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:43 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:43 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:43 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-da21ad4d-8d60-48ba-8a7a-e6996edbf816" returned: 0 in 0.298s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-quobyte-da21ad4d-8d60-48ba-8a7a-e6996edbf816" released by "delete_volume" :: held 0.844s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Created reservations ['a110befa-2a47-4788-b6e7-166293a3be58', 'd4192936-a229-4134-a13f-3bfd8cee12b1', '024fc10b-ac02-4b51-bf22-87bae56b517f', '1ce4124d-cb1c-4a95-b68f-afd4c18ca8b0'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:43 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.322s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Deleted volume successfully. Sep 28 18:31:43 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:43 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-946d416a-a12f-4c1a-a7c7-5f0960ae955b tempest-ProjectReaderTests-1721266977 None] Lock "cinder-a3bd694b-2d53-4c92-a407-4f737a73f153-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:44 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.433s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:44 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:44 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Deleted volume successfully. Sep 28 18:31:44 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0fc3dd05-2962-4e92-bc41-9b18454a3531 tempest-SnapshotDependencyTests-947627282 None] Lock "cinder-da21ad4d-8d60-48ba-8a7a-e6996edbf816-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (24edad28-9c46-453b-94c3-a8c3f7166b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0ed3f2-7850-4e2f-aa7a-6de21f386ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0ed3f2-7850-4e2f-aa7a-6de21f386ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095527210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932c8605-59ad-4c8c-84a1-6b054662315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:45Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633cfad2-abe3-4c8e-9b6a-10232eb95d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633cfad2-abe3-4c8e-9b6a-10232eb95d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4d48fc-58de-4e0c-831f-d49f1431daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4d48fc-58de-4e0c-831f-d49f1431daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932c8605-59ad-4c8c-84a1-6b054662315e', 'volume_name': 'volume-932c8605-59ad-4c8c-84a1-6b054662315e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e380382-f553-43eb-bd95-bd7e056865e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e380382-f553-43eb-bd95-bd7e056865e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ccbcec-7d96-414b-8434-6b939f48413b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Volume 932c8605-59ad-4c8c-84a1-6b054662315e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932c8605-59ad-4c8c-84a1-6b054662315e', 'volume_size': 1} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095527210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932c8605-59ad-4c8c-84a1-6b054662315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:45Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Creating volume 932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:45 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:45 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e 1073741824 Sep 28 18:31:45 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:45 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e 1073741824" returned: 0 in 0.492s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:46 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e Sep 28 18:31:46 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:46 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e" returned: 0 in 0.374s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ccbcec-7d96-414b-8434-6b939f48413b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932c8605-59ad-4c8c-84a1-6b054662315e', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d51555-e4e3-4f93-a54a-507d3db32aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:46 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Volume volume-932c8605-59ad-4c8c-84a1-6b054662315e (932c8605-59ad-4c8c-84a1-6b054662315e): created successfully Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d51555-e4e3-4f93-a54a-507d3db32aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:46 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (24edad28-9c46-453b-94c3-a8c3f7166b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:46 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-9b00d495-f554-45f6-ba30-e0f50458d9bc tempest-ProjectReaderTests-1721266977 None] Created volume successfully. Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (f9a38ee4-3a1f-4de7-9c06-312dc4af3a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f87153-5290-4859-a5b8-1db057e00874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f87153-5290-4859-a5b8-1db057e00874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141304649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c059fcb1-179c-475b-93a9-23d0eaaeac84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:48Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2447366-3dab-40d1-8310-356b3ddc7308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2447366-3dab-40d1-8310-356b3ddc7308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:47 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73e2823-0fd1-4415-8045-41637e42dd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73e2823-0fd1-4415-8045-41637e42dd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c059fcb1-179c-475b-93a9-23d0eaaeac84', 'volume_name': 'volume-c059fcb1-179c-475b-93a9-23d0eaaeac84', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52afb04b-21b6-4065-b967-615552636af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52afb04b-21b6-4065-b967-615552636af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53743f87-5d1b-4898-a3ad-3fa8ae3c8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:48 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Volume c059fcb1-179c-475b-93a9-23d0eaaeac84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c059fcb1-179c-475b-93a9-23d0eaaeac84', 'volume_size': 1} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Creating offline snapshot 970b2157-154a-405c-bb7e-0b106fb46cd0 of volume 932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[0785df09-1758-4bc4-a29e-9b61d27e7eb7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:48 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e Sep 28 18:31:48 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:48 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e" returned: 0 in 0.428s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:48 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 1G Sep 28 18:31:48 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:48 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 1G" returned: 0 in 0.456s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932c8605-59ad-4c8c-84a1-6b054662315e -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:48 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932c8605-59ad-4c8c-84a1-6b054662315e -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 Sep 28 18:31:48 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:49 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932c8605-59ad-4c8c-84a1-6b054662315e -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0" returned: 0 in 0.384s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:49 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 is being set with open permissions: ugo+rw Sep 28 18:31:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:49 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 Sep 28 18:31:49 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:49 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0" returned: 0 in 0.325s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:49 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.info Sep 28 18:31:49 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:49 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.info" returned: 0 in 0.264s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:49 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.info is being set with open permissions: ugo+rw Sep 28 18:31:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:49 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.info Sep 28 18:31:49 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:50 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.info" returned: 0 in 0.283s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.253s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141304649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c059fcb1-179c-475b-93a9-23d0eaaeac84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:48Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Creating volume c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:50 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:50 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-e4b9c269-adf7-4c10-b0b3-ce67b8f5f09c tempest-ProjectReaderTests-1721266977 None] Create snapshot completed successfully Sep 28 18:31:50 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 1073741824 Sep 28 18:31:50 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:50 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 1073741824" returned: 0 in 0.496s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:50 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 Sep 28 18:31:50 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-970b2157-154a-405c-bb7e-0b106fb46cd0-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Lock "cinder-970b2157-154a-405c-bb7e-0b106fb46cd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-932c8605-59ad-4c8c-84a1-6b054662315e" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-932c8605-59ad-4c8c-84a1-6b054662315e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-970b2157-154a-405c-bb7e-0b106fb46cd0" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-970b2157-154a-405c-bb7e-0b106fb46cd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Deleting offline snapshot 970b2157-154a-405c-bb7e-0b106fb46cd0 of volume 932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] snapshot_file for this snap is: volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[990fbf5a-07e2-472b-a63e-e43c74bed6ce]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:51 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84" returned: 0 in 0.297s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53743f87-5d1b-4898-a3ad-3fa8ae3c8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c059fcb1-179c-475b-93a9-23d0eaaeac84', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8be28c-c8c5-441a-8f35-9e7e5e919872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:51 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Volume volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 (c059fcb1-179c-475b-93a9-23d0eaaeac84): created successfully Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8be28c-c8c5-441a-8f35-9e7e5e919872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (f9a38ee4-3a1f-4de7-9c06-312dc4af3a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:51 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7cb49ec7-11cc-4472-b190-1cd8b9f2374f tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:31:51 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 Sep 28 18:31:51 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:51 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932c8605-59ad-4c8c-84a1-6b054662315e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3887002-28af-4269-8f46-1f567f2f3d5a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:51 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e Sep 28 18:31:51 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:51 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e" returned: 0 in 0.373s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:51 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 Sep 28 18:31:51 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:52 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0" returned: 0 in 0.421s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:52 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0 Sep 28 18:31:52 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Creating offline snapshot 02672efe-d75b-4e1d-9d11-e344b9306694 of volume c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53e3b0-893b-4dd1-bf3c-6cccea9d318d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:52 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 Sep 28 18:31:52 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:52 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e.970b2157-154a-405c-bb7e-0b106fb46cd0" returned: 0 in 0.347s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-970b2157-154a-405c-bb7e-0b106fb46cd0" released by "_delete_snapshot" :: held 1.669s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-932c8605-59ad-4c8c-84a1-6b054662315e" released by "delete_snapshot" :: held 1.695s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Created reservations ['e52080e7-916a-4dcc-8bf0-dbf2883d2ad3', '81604fa3-3f1d-4348-885d-cf7dd2d0b2ea', 'e6596dcc-2c3c-42e7-96bb-e10b4c4cb8f2', 'fc113adf-b204-4f3c-a24f-c463cf84b3f1'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Delete snapshot completed successfully. Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-679a193c-4ff5-4555-976c-f8db7ea3f2cb tempest-ProjectReaderTests-1721266977 None] Lock "cinder-970b2157-154a-405c-bb7e-0b106fb46cd0-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:52 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84" returned: 0 in 0.382s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:52 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 1G Sep 28 18:31:52 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-932c8605-59ad-4c8c-84a1-6b054662315e-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-932c8605-59ad-4c8c-84a1-6b054662315e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-932c8605-59ad-4c8c-84a1-6b054662315e" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-932c8605-59ad-4c8c-84a1-6b054662315e" acquired by "delete_volume" :: waited 0.028s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[023cbd59-83ce-452e-8383-8d6dcf5c0126]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:53 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 1G" returned: 0 in 0.535s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:53 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e Sep 28 18:31:53 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:53 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 Sep 28 18:31:53 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:53 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e" returned: 0 in 0.419s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:53 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e Sep 28 18:31:53 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:53 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694" returned: 0 in 0.373s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:53 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 is being set with open permissions: ugo+rw Sep 28 18:31:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:53 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 Sep 28 18:31:53 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:54 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-932c8605-59ad-4c8c-84a1-6b054662315e" returned: 0 in 0.289s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-932c8605-59ad-4c8c-84a1-6b054662315e" released by "delete_volume" :: held 0.804s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:54 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694" returned: 0 in 0.323s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:54 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.info Sep 28 18:31:54 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Created reservations ['fdd088b2-53c2-41b0-b3f8-199619f2327b', '719e8125-6473-427d-b4eb-424336ede6db', 'e94a7f4f-651b-45c0-9077-bd585afa3e35', 'd35fa117-e821-4024-b8d1-9cf3d9e8d175'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:54 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:54 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:54 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.info" returned: 0 in 0.378s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:54 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.info is being set with open permissions: ugo+rw Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:54 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.info Sep 28 18:31:54 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:54 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:54 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Deleted volume successfully. Sep 28 18:31:54 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-98095248-90ff-4c3c-b9a2-cd71fed1d261 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-932c8605-59ad-4c8c-84a1-6b054662315e-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:55 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.info" returned: 0 in 0.345s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-24142ead-63d8-4db2-9b6c-043f00f29a88 tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (9557e6a8-7021-4890-bae2-5bb371c48336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea5105-f0ed-4046-a354-a1f5bd37388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea5105-f0ed-4046-a354-a1f5bd37388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315578346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8147c843-9e6d-4485-8db9-c563f9aad58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:55Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d64ff1-de53-428a-907b-72ee066e7111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d64ff1-de53-428a-907b-72ee066e7111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c319ca-72a1-4fc7-b24a-c060abaa05c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c319ca-72a1-4fc7-b24a-c060abaa05c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8147c843-9e6d-4485-8db9-c563f9aad58b', 'volume_name': 'volume-8147c843-9e6d-4485-8db9-c563f9aad58b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7642e478-1071-4c96-8ca6-d4201427b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7642e478-1071-4c96-8ca6-d4201427b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baa34f7-d833-4ad2-a4ce-c320fa730e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:55 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Volume 8147c843-9e6d-4485-8db9-c563f9aad58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8147c843-9e6d-4485-8db9-c563f9aad58b', 'volume_size': 1} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315578346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8147c843-9e6d-4485-8db9-c563f9aad58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:55Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Creating volume 8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:55 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:55 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b 1073741824 Sep 28 18:31:55 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:55 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b 1073741824" returned: 0 in 0.496s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-02672efe-d75b-4e1d-9d11-e344b9306694-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:55 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b Sep 28 18:31:55 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Lock "cinder-02672efe-d75b-4e1d-9d11-e344b9306694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-c059fcb1-179c-475b-93a9-23d0eaaeac84" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c059fcb1-179c-475b-93a9-23d0eaaeac84" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-02672efe-d75b-4e1d-9d11-e344b9306694" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-02672efe-d75b-4e1d-9d11-e344b9306694" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot 02672efe-d75b-4e1d-9d11-e344b9306694 of volume c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47574dd-e870-4f80-997c-d964988087a0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:55 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 Sep 28 18:31:55 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:56 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b" returned: 0 in 0.339s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baa34f7-d833-4ad2-a4ce-c320fa730e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8147c843-9e6d-4485-8db9-c563f9aad58b', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0949507e-30fe-47bd-8575-2153accf4f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:56 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Volume volume-8147c843-9e6d-4485-8db9-c563f9aad58b (8147c843-9e6d-4485-8db9-c563f9aad58b): created successfully Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0949507e-30fe-47bd-8575-2153accf4f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (9557e6a8-7021-4890-bae2-5bb371c48336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:56 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c354c886-62f6-4b68-b00d-e50a507980d8 tempest-ProjectReaderTests-1721266977 None] Created volume successfully. Sep 28 18:31:56 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694" returned: 0 in 0.432s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c059fcb1-179c-475b-93a9-23d0eaaeac84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[24af39dd-2d34-4ac2-86ab-9c29ed6eac7a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:56 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 Sep 28 18:31:56 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:56 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84" returned: 0 in 0.428s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:56 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:56 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 Sep 28 18:31:56 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:57 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694" returned: 0 in 0.429s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:57 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694 Sep 28 18:31:57 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Creating offline snapshot 79ec313b-2f11-48ec-9d42-c531eee3c297 of volume 8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:57 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84.02672efe-d75b-4e1d-9d11-e344b9306694" returned: 0 in 0.333s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[76eaf102-83b1-4f19-bccb-aa8e85f733d1]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-02672efe-d75b-4e1d-9d11-e344b9306694" released by "_delete_snapshot" :: held 1.783s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c059fcb1-179c-475b-93a9-23d0eaaeac84" released by "delete_snapshot" :: held 1.815s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Created reservations ['16a53017-46cf-42a4-b604-16e3955a24d6', '4b9b69d8-e964-4bd8-844a-2096989685c8', '2699a6ab-c3cf-4380-b11a-fe6884ac9fbf', '46909955-392c-4c10-9f6d-6295a5c37f37'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:57 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b Sep 28 18:31:57 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:57 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-83776c3d-29f4-45a5-99f5-17376d82f899 tempest-ProjectMemberTests-884815338 None] Lock "cinder-02672efe-d75b-4e1d-9d11-e344b9306694-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-c059fcb1-179c-475b-93a9-23d0eaaeac84-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Lock "cinder-c059fcb1-179c-475b-93a9-23d0eaaeac84-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:57 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-c059fcb1-179c-475b-93a9-23d0eaaeac84" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c059fcb1-179c-475b-93a9-23d0eaaeac84" acquired by "delete_volume" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:58 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b" returned: 0 in 0.491s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8aa1e-665f-49d8-af7d-7c691389a723]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:58 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 1G Sep 28 18:31:58 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:58 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 Sep 28 18:31:58 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:58 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84" returned: 0 in 0.421s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:58 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 1G" returned: 0 in 0.448s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8147c843-9e6d-4485-8db9-c563f9aad58b -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:58 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84 Sep 28 18:31:58 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:58 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8147c843-9e6d-4485-8db9-c563f9aad58b -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 Sep 28 18:31:58 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:58 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-c059fcb1-179c-475b-93a9-23d0eaaeac84" returned: 0 in 0.269s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c059fcb1-179c-475b-93a9-23d0eaaeac84" released by "delete_volume" :: held 0.768s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:58 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8147c843-9e6d-4485-8db9-c563f9aad58b -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:58 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 is being set with open permissions: ugo+rw Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:58 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 Sep 28 18:31:58 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Created reservations ['a3af61ec-e066-439e-a2b4-385d5b9f9b63', 'c997cccf-4f75-4937-bcdd-e7ac28ad45e7', '67b51bf1-bd37-4bf4-aacf-46c2c1bbf9df', 'e3311c94-a7fa-4b1b-9e1c-ba0ca47ac233'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:58 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:31:58 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:59 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297" returned: 0 in 0.282s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:59 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.info Sep 28 18:31:59 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:59 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.300s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:59 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-623869bd-d7af-44ad-85a2-6193afa07b2d tempest-ProjectMemberTests-884815338 None] Lock "cinder-c059fcb1-179c-475b-93a9-23d0eaaeac84-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:59 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.info" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:59 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.info is being set with open permissions: ugo+rw Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:59 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.info Sep 28 18:31:59 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (6c12b42e-9cab-4b48-af1b-e2e02dd68213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa40d99-453f-494e-8d60-7dc16d9316c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa40d99-453f-494e-8d60-7dc16d9316c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639298586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882eea7c-740c-4ed7-ad39-e146c2e44485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:00Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96801a1a-9e4d-40a1-adaa-9826f2ad635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:59 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96801a1a-9e4d-40a1-adaa-9826f2ad635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493074ec-1cea-4340-b3a5-a35cb2b8f55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493074ec-1cea-4340-b3a5-a35cb2b8f55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882eea7c-740c-4ed7-ad39-e146c2e44485', 'volume_name': 'volume-882eea7c-740c-4ed7-ad39-e146c2e44485', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9652e0b4-f68e-4350-8659-362f1a4093fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9652e0b4-f68e-4350-8659-362f1a4093fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7942f861-9cd3-41b4-b96c-01324eba9b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:59 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Volume 882eea7c-740c-4ed7-ad39-e146c2e44485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882eea7c-740c-4ed7-ad39-e146c2e44485', 'volume_size': 1} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.info" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639298586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882eea7c-740c-4ed7-ad39-e146c2e44485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:00Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Creating volume 882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:59 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:31:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:59 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 1073741824 Sep 28 18:31:59 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:59 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-fd0b7d23-5c0d-43e9-92cf-7990d154eb72 tempest-ProjectReaderTests-1721266977 None] Create snapshot completed successfully Sep 28 18:32:00 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 1073741824" returned: 0 in 0.452s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:00 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 Sep 28 18:32:00 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-79ec313b-2f11-48ec-9d42-c531eee3c297-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-79ec313b-2f11-48ec-9d42-c531eee3c297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-8147c843-9e6d-4485-8db9-c563f9aad58b" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-8147c843-9e6d-4485-8db9-c563f9aad58b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-79ec313b-2f11-48ec-9d42-c531eee3c297" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-79ec313b-2f11-48ec-9d42-c531eee3c297" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Deleting offline snapshot 79ec313b-2f11-48ec-9d42-c531eee3c297 of volume 8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] snapshot_file for this snap is: volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:00 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485" returned: 0 in 0.292s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51ce454-bc0e-4ffc-bfaf-38f1b61d3b3c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7942f861-9cd3-41b4-b96c-01324eba9b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882eea7c-740c-4ed7-ad39-e146c2e44485', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2310c8-a779-4635-a30a-b8cc9fb2e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:00 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Volume volume-882eea7c-740c-4ed7-ad39-e146c2e44485 (882eea7c-740c-4ed7-ad39-e146c2e44485): created successfully Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2310c8-a779-4635-a30a-b8cc9fb2e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:00 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (6c12b42e-9cab-4b48-af1b-e2e02dd68213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-449c8bfe-10bc-4cf4-8d26-e65f5658bd53 tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:32:00 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 Sep 28 18:32:00 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:01 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297" returned: 0 in 0.368s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8147c843-9e6d-4485-8db9-c563f9aad58b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f5603-977b-43c5-a072-285cb852b838]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:01 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b Sep 28 18:32:01 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:01 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b" returned: 0 in 0.335s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:01 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 Sep 28 18:32:01 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:01 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297" returned: 0 in 0.352s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:01 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297 Sep 28 18:32:01 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Creating offline snapshot c72cb780-d3f3-4bb7-82d0-cfa7120221ba of volume 882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dedf709-3163-4b54-b97f-74fdfdb0e63d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:02 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b.79ec313b-2f11-48ec-9d42-c531eee3c297" returned: 0 in 0.291s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-79ec313b-2f11-48ec-9d42-c531eee3c297" released by "_delete_snapshot" :: held 1.465s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-8147c843-9e6d-4485-8db9-c563f9aad58b" released by "delete_snapshot" :: held 1.499s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:02 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 Sep 28 18:32:02 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Created reservations ['a7ad3337-649f-42df-bf7c-874fde021df3', 'bea1b63c-fa0e-4f74-9166-1d6f22a1ef4f', '60619b6d-ced4-4169-a8db-4141ffdab678', '2011b317-c8a1-408b-805f-88664ad58ab9'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:02 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Delete snapshot completed successfully. Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-3907a8c7-1652-4301-bf7c-aab658cdcb56 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-79ec313b-2f11-48ec-9d42-c531eee3c297-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:02 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485" returned: 0 in 0.408s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:02 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba 1G Sep 28 18:32:02 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-8147c843-9e6d-4485-8db9-c563f9aad58b-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Lock "cinder-8147c843-9e6d-4485-8db9-c563f9aad58b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-8147c843-9e6d-4485-8db9-c563f9aad58b" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-8147c843-9e6d-4485-8db9-c563f9aad58b" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff73ab9a-dc47-4e9d-ae58-316c326ad771]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:02 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba 1G" returned: 0 in 0.468s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882eea7c-740c-4ed7-ad39-e146c2e44485 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:02 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882eea7c-740c-4ed7-ad39-e146c2e44485 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba Sep 28 18:32:02 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:03 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b Sep 28 18:32:03 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:03 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-882eea7c-740c-4ed7-ad39-e146c2e44485 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba" returned: 0 in 0.321s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:03 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba is being set with open permissions: ugo+rw Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:03 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba Sep 28 18:32:03 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:03 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b" returned: 0 in 0.401s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:03 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b Sep 28 18:32:03 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:03 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba" returned: 0 in 0.284s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:03 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8147c843-9e6d-4485-8db9-c563f9aad58b" returned: 0 in 0.265s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:03 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.info Sep 28 18:32:03 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-8147c843-9e6d-4485-8db9-c563f9aad58b" released by "delete_volume" :: held 0.742s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Created reservations ['8233c54b-df96-432d-b8e5-92052e896ac9', 'cb094b3e-4d12-43d9-a582-20bad7af102f', 'ff3a1556-12b6-419a-a722-fef15725c683', '10a2f257-5585-4828-839d-3757c7e25a4e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:03 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:03 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:03 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.info" returned: 0 in 0.282s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:03 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.info is being set with open permissions: ugo+rw Sep 28 18:32:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:03 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.info Sep 28 18:32:03 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:04 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.268s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Deleted volume successfully. Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:DELETE=17,cinder:UPDATE=188,cinder:SELECT=161,cinder:INSERT=54 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-987a7fd2-2909-47c8-b568-c5d95813b38c tempest-ProjectReaderTests-1721266977 None] Lock "cinder-8147c843-9e6d-4485-8db9-c563f9aad58b-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:04 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.info" returned: 0 in 0.305s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=152,cinder:UPDATE=206,cinder:INSERT=57,cinder:DELETE=18 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:32:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-66599754-1681-455f-a612-ef311975ee43 tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (c8d37bc1-0ab9-4f07-bfe4-4a2db5fcd621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe5d0a-f958-4b58-bf21-c4f42233e7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe5d0a-f958-4b58-bf21-c4f42233e7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026233816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b441938-e3bb-4344-9a7d-0d7b51035267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:04Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb093d69-dcb7-4fd1-a4d8-5baed52ca00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb093d69-dcb7-4fd1-a4d8-5baed52ca00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f190c08-6e23-4688-8a80-cda3eb6c3903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f190c08-6e23-4688-8a80-cda3eb6c3903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b441938-e3bb-4344-9a7d-0d7b51035267', 'volume_name': 'volume-5b441938-e3bb-4344-9a7d-0d7b51035267', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873fa721-542a-4203-bbda-cd6e294ab598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873fa721-542a-4203-bbda-cd6e294ab598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b49cc0-6268-4fac-be48-574ed1809b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Volume 5b441938-e3bb-4344-9a7d-0d7b51035267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b441938-e3bb-4344-9a7d-0d7b51035267', 'volume_size': 1} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026233816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b441938-e3bb-4344-9a7d-0d7b51035267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0f968eca14c658f1f32102c376a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:04Z,use_quota=True,user_id='7a2a37fe0b984203a736dfca6d579ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Creating volume 5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:04 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:04 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 1073741824 Sep 28 18:32:04 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:05 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 1073741824" returned: 0 in 0.414s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:05 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 Sep 28 18:32:05 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-c72cb780-d3f3-4bb7-82d0-cfa7120221ba-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Lock "cinder-c72cb780-d3f3-4bb7-82d0-cfa7120221ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-882eea7c-740c-4ed7-ad39-e146c2e44485" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-882eea7c-740c-4ed7-ad39-e146c2e44485" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-c72cb780-d3f3-4bb7-82d0-cfa7120221ba" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c72cb780-d3f3-4bb7-82d0-cfa7120221ba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot c72cb780-d3f3-4bb7-82d0-cfa7120221ba of volume 882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec22da3-1fb1-4123-a62e-5db5003e42c1]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:05 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267" returned: 0 in 0.292s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b49cc0-6268-4fac-be48-574ed1809b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b441938-e3bb-4344-9a7d-0d7b51035267', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aab640-738b-4280-b337-141cd3a27f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:05 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Volume volume-5b441938-e3bb-4344-9a7d-0d7b51035267 (5b441938-e3bb-4344-9a7d-0d7b51035267): created successfully Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aab640-738b-4280-b337-141cd3a27f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Flow 'volume_create_manager' (c8d37bc1-0ab9-4f07-bfe4-4a2db5fcd621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:05 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2b5e6fd5-61c2-48fb-9990-8f3ef03c2911 tempest-ProjectReaderTests-1721266977 None] Created volume successfully. Sep 28 18:32:05 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba Sep 28 18:32:05 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Creating offline snapshot 51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc of volume 5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:05 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b12e0-687a-4f4d-a31a-16292cdf2d0b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba" returned: 0 in 0.434s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-882eea7c-740c-4ed7-ad39-e146c2e44485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[24325891-d27c-497f-91fe-0e84e02cafc0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:05 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 Sep 28 18:32:05 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:05 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 Sep 28 18:32:05 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:06 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267" returned: 0 in 0.371s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:06 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc 1G Sep 28 18:32:06 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:06 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485" returned: 0 in 0.377s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:06 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba Sep 28 18:32:06 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:06 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba" returned: 0 in 0.345s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:06 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba Sep 28 18:32:06 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:06 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc 1G" returned: 0 in 0.424s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b441938-e3bb-4344-9a7d-0d7b51035267 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:06 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b441938-e3bb-4344-9a7d-0d7b51035267 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc Sep 28 18:32:06 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:06 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485.c72cb780-d3f3-4bb7-82d0-cfa7120221ba" returned: 0 in 0.286s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c72cb780-d3f3-4bb7-82d0-cfa7120221ba" released by "_delete_snapshot" :: held 1.568s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-882eea7c-740c-4ed7-ad39-e146c2e44485" released by "delete_snapshot" :: held 1.592s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:06 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b441938-e3bb-4344-9a7d-0d7b51035267 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" returned: 0 in 0.321s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:06 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc is being set with open permissions: ugo+rw Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:06 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc Sep 28 18:32:06 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:06 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Created reservations ['6c7c07d1-38af-48b3-9ff0-a4d28c12874a', '812d3044-c1ca-4e9e-bfe9-259014220f81', '2aab5a95-4cc7-491b-8963-d00628f67bd0', '6c2e0e41-4686-4d07-b724-2dae2676a86e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-f04b023f-28f0-4945-9291-63670cdaad53 tempest-ProjectMemberTests-884815338 None] Lock "cinder-c72cb780-d3f3-4bb7-82d0-cfa7120221ba-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:07 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" returned: 0 in 0.253s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:07 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.info Sep 28 18:32:07 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:07 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.info" returned: 0 in 0.250s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:07 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.info is being set with open permissions: ugo+rw Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:07 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.info Sep 28 18:32:07 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-882eea7c-740c-4ed7-ad39-e146c2e44485-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Lock "cinder-882eea7c-740c-4ed7-ad39-e146c2e44485-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-882eea7c-740c-4ed7-ad39-e146c2e44485" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-882eea7c-740c-4ed7-ad39-e146c2e44485" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dce7f9-36cc-4f34-8d31-53e29cfe612c]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:07 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.info" returned: 0 in 0.256s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:07 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-90947170-58cf-40a6-9ba9-61e38bc3b5fe tempest-ProjectReaderTests-1721266977 None] Create snapshot completed successfully Sep 28 18:32:07 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 Sep 28 18:32:07 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-5b441938-e3bb-4344-9a7d-0d7b51035267" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5b441938-e3bb-4344-9a7d-0d7b51035267" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Deleting offline snapshot 51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc of volume 5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] snapshot_file for this snap is: volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d6764-ed7e-48fa-ad0b-b544f0138e11]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:08 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485" returned: 0 in 0.435s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:08 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485 Sep 28 18:32:08 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:08 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc Sep 28 18:32:08 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:08 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-882eea7c-740c-4ed7-ad39-e146c2e44485" returned: 0 in 0.319s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:08 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-882eea7c-740c-4ed7-ad39-e146c2e44485" released by "delete_volume" :: held 0.836s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" returned: 0 in 0.404s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b441938-e3bb-4344-9a7d-0d7b51035267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfa3a8f-7d4a-4486-8dba-cd0d9080c267]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Created reservations ['f0969bd4-d32c-460b-8154-f9d614f16d33', 'b82ca70a-26e6-46b2-a699-101c337d310f', 'a163975f-e1f4-41d5-9345-8c7d9eaa1477', 'e1624524-70d0-4ec1-8283-57788a9f5bec'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:08 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 Sep 28 18:32:08 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:08 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:08 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:08 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.284s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:08 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267" returned: 0 in 0.444s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:08 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:32:08 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc Sep 28 18:32:08 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-65118f6e-7bb2-4a48-b6c4-b00863848c23 tempest-ProjectMemberTests-884815338 None] Lock "cinder-882eea7c-740c-4ed7-ad39-e146c2e44485-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (351d5584-b08f-4e61-9c17-4d506b5cdcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ea821e-3744-47ce-ab14-b1352e47157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ea821e-3744-47ce-ab14-b1352e47157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225288010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3798715-a455-42b4-a500-066afeecd3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:09Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6deed923-a179-4f82-b8e1-87336c892297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6deed923-a179-4f82-b8e1-87336c892297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6270542b-c273-4232-bc7e-cdb1d44dd983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6270542b-c273-4232-bc7e-cdb1d44dd983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3798715-a455-42b4-a500-066afeecd3ad', 'volume_name': 'volume-e3798715-a455-42b4-a500-066afeecd3ad', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833ca559-de46-458d-a08a-c2aef0c59974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833ca559-de46-458d-a08a-c2aef0c59974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1489a2-f604-4ea6-abcd-1a0795892f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:09 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Volume e3798715-a455-42b4-a500-066afeecd3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3798715-a455-42b4-a500-066afeecd3ad', 'volume_size': 1} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225288010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3798715-a455-42b4-a500-066afeecd3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:09Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Creating volume e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:09 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:09 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad 1073741824 Sep 28 18:32:09 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:09 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" returned: 0 in 0.407s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:09 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc Sep 28 18:32:09 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:09 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267.51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" returned: 0 in 0.256s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc" released by "_delete_snapshot" :: held 1.627s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5b441938-e3bb-4344-9a7d-0d7b51035267" released by "delete_snapshot" :: held 1.661s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Created reservations ['fa711b53-2696-4e5d-81f9-0bd7c21c2687', 'edb2aaeb-66a5-4a5e-866c-254b41c2b14d', '8a5ceb36-a966-4a99-8053-1971e08aaac9', '8a6c751a-70ac-4737-b4a4-64dd62afeb60'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:09 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Delete snapshot completed successfully. Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-175e4437-51bf-4988-a02c-da95a2e0c075 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-51fca2a0-3dbb-4ce2-9f37-18bac1e7e5dc-delete_snapshot" released by "delete_snapshot" :: held 1.822s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:09 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad 1073741824" returned: 0 in 0.494s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:09 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad Sep 28 18:32:09 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:10 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad" returned: 0 in 0.271s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1489a2-f604-4ea6-abcd-1a0795892f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3798715-a455-42b4-a500-066afeecd3ad', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c418c68-4827-4b9a-b598-e9d50fd0b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:10 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Volume volume-e3798715-a455-42b4-a500-066afeecd3ad (e3798715-a455-42b4-a500-066afeecd3ad): created successfully Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c418c68-4827-4b9a-b598-e9d50fd0b394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (351d5584-b08f-4e61-9c17-4d506b5cdcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-5b441938-e3bb-4344-9a7d-0d7b51035267-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:10 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7be01ecb-005f-482d-838e-df3aa6d2dec0 tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-5b441938-e3bb-4344-9a7d-0d7b51035267-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "cinder-quobyte-5b441938-e3bb-4344-9a7d-0d7b51035267" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5b441938-e3bb-4344-9a7d-0d7b51035267" acquired by "delete_volume" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d45f5a-59fb-46c2-866d-82e6fe48d217]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:10 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 Sep 28 18:32:10 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:10 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267" returned: 0 in 0.379s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:10 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267 Sep 28 18:32:10 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:10 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-5b441938-e3bb-4344-9a7d-0d7b51035267" returned: 0 in 0.263s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-quobyte-5b441938-e3bb-4344-9a7d-0d7b51035267" released by "delete_volume" :: held 0.708s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Created reservations ['87070237-86c3-45ef-881a-3dbb00c55c23', '64c8347f-28cd-4df4-9097-a82e232e6406', '1611c152-4bec-4537-a020-227d5510d542', 'fffe0303-3351-424d-aefe-28af7ebffbad'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:11 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:11 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:11 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.303s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:11 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Deleted volume successfully. Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-46939003-7ff2-4d24-878d-d005d4e72f51 tempest-ProjectReaderTests-1721266977 None] Lock "cinder-5b441938-e3bb-4344-9a7d-0d7b51035267-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Creating offline snapshot 9fb3ae00-c04c-41e4-9afb-25385880f093 of volume e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[322bb2ea-44d6-4d78-bfe7-927e182c6055]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:11 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad Sep 28 18:32:11 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:11 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad" returned: 0 in 0.396s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:11 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:11 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 1G Sep 28 18:32:11 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:12 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 1G" returned: 0 in 0.479s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3798715-a455-42b4-a500-066afeecd3ad -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:12 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3798715-a455-42b4-a500-066afeecd3ad -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 Sep 28 18:32:12 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:12 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3798715-a455-42b4-a500-066afeecd3ad -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093" returned: 0 in 0.323s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:12 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 is being set with open permissions: ugo+rw Sep 28 18:32:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:12 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 Sep 28 18:32:12 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:12 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093" returned: 0 in 0.251s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:12 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:12 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.info Sep 28 18:32:12 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:13 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.info" returned: 0 in 0.283s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:13 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.info is being set with open permissions: ugo+rw Sep 28 18:32:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:13 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.info Sep 28 18:32:13 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:13 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.info" returned: 0 in 0.253s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:13 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:13 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0c5bbf5c-81ab-421e-8171-56714478f23c tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-9fb3ae00-c04c-41e4-9afb-25385880f093-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Lock "cinder-9fb3ae00-c04c-41e4-9afb-25385880f093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-e3798715-a455-42b4-a500-066afeecd3ad" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-e3798715-a455-42b4-a500-066afeecd3ad" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-9fb3ae00-c04c-41e4-9afb-25385880f093" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-9fb3ae00-c04c-41e4-9afb-25385880f093" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot 9fb3ae00-c04c-41e4-9afb-25385880f093 of volume e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21adde-0f3b-4eeb-839c-465dd42ca1a1]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:14 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:14 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 Sep 28 18:32:14 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:15 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093" returned: 0 in 0.391s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3798715-a455-42b4-a500-066afeecd3ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad520db-8e35-45fe-b391-e72be005c556]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:15 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad Sep 28 18:32:15 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Flow 'volume_create_manager' (51c12078-fcf1-421d-b127-5c8b170c01f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07911dc5-8a4e-4f40-b72b-9c5781afbc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:15 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad" returned: 0 in 0.489s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07911dc5-8a4e-4f40-b72b-9c5781afbc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844526189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208e010f-7dd8-47f1-bdf8-83b59b9299fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d456e7eee34108a6ad164c1ab87db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:16Z,use_quota=True,user_id='47c2ad6cd0a14aef89c8e10195d540c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de66e814-00ef-485d-b376-23856e8cdcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:15 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 Sep 28 18:32:15 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de66e814-00ef-485d-b376-23856e8cdcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d561a2d-562d-4eb6-8087-c3ff7bbd6b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d561a2d-562d-4eb6-8087-c3ff7bbd6b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208e010f-7dd8-47f1-bdf8-83b59b9299fe', 'volume_name': 'volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4543c645-afec-4beb-b85b-d8cc2c6281e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4543c645-afec-4beb-b85b-d8cc2c6281e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df5056a-da73-4127-b4f5-adbf6b3c8e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:15 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Volume 208e010f-7dd8-47f1-bdf8-83b59b9299fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe', 'volume_size': 1} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844526189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208e010f-7dd8-47f1-bdf8-83b59b9299fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d456e7eee34108a6ad164c1ab87db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:16Z,use_quota=True,user_id='47c2ad6cd0a14aef89c8e10195d540c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Creating volume 208e010f-7dd8-47f1-bdf8-83b59b9299fe {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:15 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:15 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:15 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe 1073741824 Sep 28 18:32:15 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:16 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093" returned: 0 in 0.357s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:16 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093 Sep 28 18:32:16 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:16 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe 1073741824" returned: 0 in 0.498s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:16 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad.9fb3ae00-c04c-41e4-9afb-25385880f093" returned: 0 in 0.300s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:16 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe Sep 28 18:32:16 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-9fb3ae00-c04c-41e4-9afb-25385880f093" released by "_delete_snapshot" :: held 1.653s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-e3798715-a455-42b4-a500-066afeecd3ad" released by "delete_snapshot" :: held 1.679s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Created reservations ['c2662e28-413b-4ddb-abbf-b9de5bfbbf08', '012f2265-4f1b-47e1-b7c4-8870d3f05672', '281a6bf8-4679-4f40-b649-a0b07f33e1ad', '3e43c30d-0737-4ab2-b0a1-fddac3870b14'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-a9a7dba0-672c-475f-ae83-6631e9385986 tempest-ProjectMemberTests-884815338 None] Lock "cinder-9fb3ae00-c04c-41e4-9afb-25385880f093-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:16 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe" returned: 0 in 0.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df5056a-da73-4127-b4f5-adbf6b3c8e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52997181-acae-4606-9113-4a3331712817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:16 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Volume volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe (208e010f-7dd8-47f1-bdf8-83b59b9299fe): created successfully Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52997181-acae-4606-9113-4a3331712817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Flow 'volume_create_manager' (51c12078-fcf1-421d-b127-5c8b170c01f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:16 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6f451094-a2d6-4630-a6c2-065771036a37 tempest-ProjectReaderTests-2035661473 None] Created volume successfully. Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-e3798715-a455-42b4-a500-066afeecd3ad-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Lock "cinder-e3798715-a455-42b4-a500-066afeecd3ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-e3798715-a455-42b4-a500-066afeecd3ad" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-e3798715-a455-42b4-a500-066afeecd3ad" acquired by "delete_volume" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34ee17-1f8a-43ef-af9e-d607b8801076]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:16 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:17 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad Sep 28 18:32:17 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:17 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad" returned: 0 in 0.430s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:17 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad Sep 28 18:32:17 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:17 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-e3798715-a455-42b4-a500-066afeecd3ad" returned: 0 in 0.277s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-e3798715-a455-42b4-a500-066afeecd3ad" released by "delete_volume" :: held 0.780s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Created reservations ['83a278dc-e2b8-480c-bd13-e3d319736976', '120fc8e8-cd5c-42bf-be6d-5a2c4778adb6', '9d4e1ba5-6464-4a5c-86dc-fff0384c0283', '75d1f75a-6771-4f87-822a-4b471e6f4353'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:17 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:17 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "cinder-208e010f-7dd8-47f1-bdf8-83b59b9299fe-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-208e010f-7dd8-47f1-bdf8-83b59b9299fe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "cinder-quobyte-208e010f-7dd8-47f1-bdf8-83b59b9299fe" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-quobyte-208e010f-7dd8-47f1-bdf8-83b59b9299fe" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f13555-6b4c-462c-8800-9e26348763b8]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:17 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:18 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.289s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:18 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:32:18 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe Sep 28 18:32:18 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-0551d5ec-eb37-4a67-acc7-e514f09b3e7d tempest-ProjectMemberTests-884815338 None] Lock "cinder-e3798715-a455-42b4-a500-066afeecd3ad-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:18 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe" returned: 0 in 0.429s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:18 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe Sep 28 18:32:18 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (4370a235-00a2-4b84-8414-7d28c5ba49d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fc6cb3-e2be-473f-a18e-7bcdde1917fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fc6cb3-e2be-473f-a18e-7bcdde1917fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1162162856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdf87c8-3de4-43f9-9b57-54f8c7320781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:18Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fd3ade-4be4-4e4e-be69-42563be0db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fd3ade-4be4-4e4e-be69-42563be0db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb100872-a872-401b-9ab2-9ba615c332f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb100872-a872-401b-9ab2-9ba615c332f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdf87c8-3de4-43f9-9b57-54f8c7320781', 'volume_name': 'volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c902e2ec-12dc-4b55-8863-9b459f91718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c902e2ec-12dc-4b55-8863-9b459f91718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0878b080-a84c-42b9-9605-4dfdf362f27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:18 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Volume 8bdf87c8-3de4-43f9-9b57-54f8c7320781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781', 'volume_size': 1} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1162162856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdf87c8-3de4-43f9-9b57-54f8c7320781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:18Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Creating volume 8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:18 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:18 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 1073741824 Sep 28 18:32:18 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:18 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-208e010f-7dd8-47f1-bdf8-83b59b9299fe" returned: 0 in 0.266s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-quobyte-208e010f-7dd8-47f1-bdf8-83b59b9299fe" released by "delete_volume" :: held 0.761s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Created reservations ['537ab2cf-5ce6-489d-af84-6d5472b40783', 'd7c2aef3-5582-4b6d-9715-8a7fbf8896ab', 'e26d583f-9b58-4440-b427-ffccde5bd165', '337053b2-62a7-4661-8933-02ce608bb872'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:18 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:18 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:18 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:19 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 1073741824" returned: 0 in 0.524s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:19 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.299s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Deleted volume successfully. Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-68a7b097-8e8a-4d56-b365-e9af61f875f3 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-208e010f-7dd8-47f1-bdf8-83b59b9299fe-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:19 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 Sep 28 18:32:19 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:19 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781" returned: 0 in 0.355s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0878b080-a84c-42b9-9605-4dfdf362f27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f21641-27a8-47ca-b326-e5fbd6be73e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Volume volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 (8bdf87c8-3de4-43f9-9b57-54f8c7320781): created successfully Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f21641-27a8-47ca-b326-e5fbd6be73e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (4370a235-00a2-4b84-8414-7d28c5ba49d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:19 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-b718f38d-b1d1-4e9c-91df-3e753f56fa74 tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Flow 'volume_create_manager' (7ba3a959-6d73-4149-9ff1-39efbb1b8e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82b7832-d230-49b9-93f6-5e82b75bb1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82b7832-d230-49b9-93f6-5e82b75bb1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826639402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5eb962-77ad-44c9-9475-8060b5b10837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d456e7eee34108a6ad164c1ab87db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:20Z,use_quota=True,user_id='47c2ad6cd0a14aef89c8e10195d540c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08122cb-e8e1-4aa5-9238-d112ba56d008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08122cb-e8e1-4aa5-9238-d112ba56d008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0cb429-48c5-4654-badb-6c742372d7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0cb429-48c5-4654-badb-6c742372d7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5eb962-77ad-44c9-9475-8060b5b10837', 'volume_name': 'volume-1f5eb962-77ad-44c9-9475-8060b5b10837', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c437bbc1-9763-46c8-bb1a-4518cc88dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c437bbc1-9763-46c8-bb1a-4518cc88dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c968ba5c-6cec-49f3-8486-98cc3f44ac0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:19 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Volume 1f5eb962-77ad-44c9-9475-8060b5b10837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5eb962-77ad-44c9-9475-8060b5b10837', 'volume_size': 1} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1826639402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5eb962-77ad-44c9-9475-8060b5b10837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d456e7eee34108a6ad164c1ab87db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:20Z,use_quota=True,user_id='47c2ad6cd0a14aef89c8e10195d540c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Creating volume 1f5eb962-77ad-44c9-9475-8060b5b10837 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:19 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:19 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:19 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 1073741824 Sep 28 18:32:19 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:20 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 1073741824" returned: 0 in 0.450s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:20 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 Sep 28 18:32:20 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:20 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837" returned: 0 in 0.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c968ba5c-6cec-49f3-8486-98cc3f44ac0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5eb962-77ad-44c9-9475-8060b5b10837', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa496bc-0ed9-4a25-a78e-f3f3ff52b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:20 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Volume volume-1f5eb962-77ad-44c9-9475-8060b5b10837 (1f5eb962-77ad-44c9-9475-8060b5b10837): created successfully Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa496bc-0ed9-4a25-a78e-f3f3ff52b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Flow 'volume_create_manager' (7ba3a959-6d73-4149-9ff1-39efbb1b8e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:20 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-7da23209-ee0d-40e0-9a1e-896af70dfbc4 tempest-ProjectReaderTests-2035661473 None] Created volume successfully. Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Creating offline snapshot 45ae92f6-85e1-4ecb-860a-4fcf89ad14fe of volume 8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4857e2-2f76-4a54-97ca-75372b5cf147]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:20 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:20 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 Sep 28 18:32:20 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:21 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781" returned: 0 in 0.388s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:21 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe 1G Sep 28 18:32:21 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:21 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe 1G" returned: 0 in 0.429s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:21 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe Sep 28 18:32:21 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "cinder-1f5eb962-77ad-44c9-9475-8060b5b10837-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-1f5eb962-77ad-44c9-9475-8060b5b10837-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "cinder-quobyte-1f5eb962-77ad-44c9-9475-8060b5b10837" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-quobyte-1f5eb962-77ad-44c9-9475-8060b5b10837" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f5a255-ff1d-4d52-af60-063546c78b83]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:21 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" returned: 0 in 0.327s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:21 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe is being set with open permissions: ugo+rw Sep 28 18:32:21 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:22 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe Sep 28 18:32:22 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:22 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 Sep 28 18:32:22 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:22 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" returned: 0 in 0.256s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:22 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.info Sep 28 18:32:22 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:22 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837" returned: 0 in 0.390s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:22 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837 Sep 28 18:32:22 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:22 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.info" returned: 0 in 0.263s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:22 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.info is being set with open permissions: ugo+rw Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:22 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.info Sep 28 18:32:22 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:22 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-1f5eb962-77ad-44c9-9475-8060b5b10837" returned: 0 in 0.267s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-quobyte-1f5eb962-77ad-44c9-9475-8060b5b10837" released by "delete_volume" :: held 0.703s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Created reservations ['b9683ca5-1c57-43fb-bf9e-fd01a0d11e29', 'f9f5c8a7-70dc-4968-9c80-a9c2145709ec', '7e97cc75-88b8-4507-8f4c-54fc5116b6f5', '3ae7d2ee-aa2b-4efe-93d8-a0514d46286e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:22 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:22 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:22 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.info" returned: 0 in 0.273s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:22 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:22 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-37dd9582-c1c6-4d37-b487-651d364ff2a2 tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:32:23 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:23 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.287s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:23 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:23 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Deleted volume successfully. Sep 28 18:32:23 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-517c91c8-abf6-467c-a99e-85af45953f87 tempest-ProjectReaderTests-2035661473 None] Lock "cinder-1f5eb962-77ad-44c9-9475-8060b5b10837-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-45ae92f6-85e1-4ecb-860a-4fcf89ad14fe-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Lock "cinder-45ae92f6-85e1-4ecb-860a-4fcf89ad14fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-8bdf87c8-3de4-43f9-9b57-54f8c7320781" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-8bdf87c8-3de4-43f9-9b57-54f8c7320781" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot 45ae92f6-85e1-4ecb-860a-4fcf89ad14fe of volume 8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c57790-c9ff-4f26-9537-32880a8d9162]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:24 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe Sep 28 18:32:24 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:24 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" returned: 0 in 0.444s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b29466-adcf-4d97-94f0-14cbe1427ca0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:24 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 Sep 28 18:32:24 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:24 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781" returned: 0 in 0.382s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:24 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:25 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe Sep 28 18:32:25 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:25 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" returned: 0 in 0.382s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:25 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe Sep 28 18:32:25 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:25 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:25 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781.45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" returned: 0 in 0.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-45ae92f6-85e1-4ecb-860a-4fcf89ad14fe" released by "_delete_snapshot" :: held 1.618s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-8bdf87c8-3de4-43f9-9b57-54f8c7320781" released by "delete_snapshot" :: held 1.643s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:25 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Created reservations ['49b0e2fc-1e95-460b-9f8b-4688bfa4af00', 'c442ccc9-cb2f-4517-9dbc-e8cbf07f376a', 'bce04253-c867-4ef4-be31-a721466e1f73', '8bc5b140-be0f-4379-b09c-031a14090e3f'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:25 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:32:25 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ac0439d2-5a90-436a-b3bb-8e17b51154a0 tempest-ProjectMemberTests-884815338 None] Lock "cinder-45ae92f6-85e1-4ecb-860a-4fcf89ad14fe-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-8bdf87c8-3de4-43f9-9b57-54f8c7320781-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Lock "cinder-8bdf87c8-3de4-43f9-9b57-54f8c7320781-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-8bdf87c8-3de4-43f9-9b57-54f8c7320781" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-8bdf87c8-3de4-43f9-9b57-54f8c7320781" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd8957-9cc7-4d9a-bb71-a5b0703b33ad]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:26 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 Sep 28 18:32:26 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:26 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781" returned: 0 in 0.431s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:26 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:26 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781 Sep 28 18:32:26 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:27 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-8bdf87c8-3de4-43f9-9b57-54f8c7320781" returned: 0 in 0.265s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-8bdf87c8-3de4-43f9-9b57-54f8c7320781" released by "delete_volume" :: held 0.784s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Created reservations ['72ba800d-67b4-45c3-a6cd-b04f692e4418', '4195ed35-6f68-4ce2-908f-1f7b0dd02016', 'e4750e9a-18e9-425d-8127-7518a9dea709', 'e54263be-defb-4e7e-b3d8-bbc952c22b25'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:27 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:27 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:27 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.283s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:27 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-d8ba20fe-4fd1-43a4-b58a-f750c9dcc6d6 tempest-ProjectMemberTests-884815338 None] Lock "cinder-8bdf87c8-3de4-43f9-9b57-54f8c7320781-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (c309caad-35ff-4594-acd2-dcf068840758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f90fe08-8e3e-4ba1-8967-c6c2e927b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f90fe08-8e3e-4ba1-8967-c6c2e927b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000664882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38c3b73-7a88-4329-b698-d38eb04d4cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:28Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8734f6-1ab8-456c-8bb3-3ac43a4ec2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8734f6-1ab8-456c-8bb3-3ac43a4ec2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b699862e-1aab-4623-b80a-50a4cf93a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b699862e-1aab-4623-b80a-50a4cf93a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38c3b73-7a88-4329-b698-d38eb04d4cae', 'volume_name': 'volume-f38c3b73-7a88-4329-b698-d38eb04d4cae', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:27 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1911cf3-1d7c-4bf3-b3a0-e887bc3e64ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1911cf3-1d7c-4bf3-b3a0-e887bc3e64ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c196fa02-7ca9-477c-8a16-a71a3bdff857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Volume f38c3b73-7a88-4329-b698-d38eb04d4cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38c3b73-7a88-4329-b698-d38eb04d4cae', 'volume_size': 1} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000664882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38c3b73-7a88-4329-b698-d38eb04d4cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:28Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Creating volume f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:28 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:28 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae 1073741824 Sep 28 18:32:28 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:28 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae 1073741824" returned: 0 in 0.483s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:28 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae Sep 28 18:32:28 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:28 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae" returned: 0 in 0.318s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c196fa02-7ca9-477c-8a16-a71a3bdff857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38c3b73-7a88-4329-b698-d38eb04d4cae', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63ba554-069a-49d2-b621-f6c7176c621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:28 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Volume volume-f38c3b73-7a88-4329-b698-d38eb04d4cae (f38c3b73-7a88-4329-b698-d38eb04d4cae): created successfully Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63ba554-069a-49d2-b621-f6c7176c621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:28 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (c309caad-35ff-4594-acd2-dcf068840758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:28 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-c7dbe1d4-b963-4beb-9d38-94ab0158de17 tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:32:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:30 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Creating offline snapshot c75aeb81-babf-491b-92f6-746a42c1eb21 of volume f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:30 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c3e100-0f1c-4bde-95f1-4cc5ad280bc7]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:30 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae Sep 28 18:32:30 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:30 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae" returned: 0 in 0.400s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:30 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:30 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 1G Sep 28 18:32:30 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:31 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 1G" returned: 0 in 0.479s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38c3b73-7a88-4329-b698-d38eb04d4cae -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:31 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38c3b73-7a88-4329-b698-d38eb04d4cae -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 Sep 28 18:32:31 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:31 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38c3b73-7a88-4329-b698-d38eb04d4cae -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:31 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 is being set with open permissions: ugo+rw Sep 28 18:32:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:31 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 Sep 28 18:32:31 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:31 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21" returned: 0 in 0.255s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:31 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:31 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.info Sep 28 18:32:31 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:32 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.info" returned: 0 in 0.308s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:32 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.info is being set with open permissions: ugo+rw Sep 28 18:32:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:32 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.info Sep 28 18:32:32 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:32 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.info" returned: 0 in 0.269s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:32 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:32 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-bfb94ef5-b1d2-489b-97f3-0e047e205f0f tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-c75aeb81-babf-491b-92f6-746a42c1eb21-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Lock "cinder-c75aeb81-babf-491b-92f6-746a42c1eb21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-f38c3b73-7a88-4329-b698-d38eb04d4cae" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-f38c3b73-7a88-4329-b698-d38eb04d4cae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-c75aeb81-babf-491b-92f6-746a42c1eb21" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c75aeb81-babf-491b-92f6-746a42c1eb21" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot c75aeb81-babf-491b-92f6-746a42c1eb21 of volume f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a7caf9-e0f0-49e2-93bb-9f5cc98b6f7f]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:33 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 Sep 28 18:32:33 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:33 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21" returned: 0 in 0.430s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f38c3b73-7a88-4329-b698-d38eb04d4cae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc7ffe4-3356-4473-96f1-9750f72c3887]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:33 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:34 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae Sep 28 18:32:34 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:34 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae" returned: 0 in 0.389s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:34 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 Sep 28 18:32:34 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:34 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21" returned: 0 in 0.341s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:34 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21 Sep 28 18:32:34 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:34 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:34 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae.c75aeb81-babf-491b-92f6-746a42c1eb21" returned: 0 in 0.236s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-c75aeb81-babf-491b-92f6-746a42c1eb21" released by "_delete_snapshot" :: held 1.509s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:34 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-f38c3b73-7a88-4329-b698-d38eb04d4cae" released by "delete_snapshot" :: held 1.531s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Created reservations ['5eb1dd7e-b854-488a-9c23-8546e0be77b3', '90d15515-2e7c-4b91-ae55-f40475e95600', 'bbb15bbe-cb7e-4a10-89c3-66df76d01443', '0c50505e-2044-484b-89d4-10ab28eafa9e'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:35 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-6c4dd878-c987-43d5-bf5b-46544ca8b08c tempest-ProjectMemberTests-884815338 None] Lock "cinder-c75aeb81-babf-491b-92f6-746a42c1eb21-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-f38c3b73-7a88-4329-b698-d38eb04d4cae-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Lock "cinder-f38c3b73-7a88-4329-b698-d38eb04d4cae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-f38c3b73-7a88-4329-b698-d38eb04d4cae" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-f38c3b73-7a88-4329-b698-d38eb04d4cae" acquired by "delete_volume" :: waited 0.014s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb862c0a-9047-48a7-9c98-f494257463fb]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:35 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:35 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae Sep 28 18:32:35 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:36 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae" returned: 0 in 0.362s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:36 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae Sep 28 18:32:36 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:36 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-f38c3b73-7a88-4329-b698-d38eb04d4cae" returned: 0 in 0.261s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-f38c3b73-7a88-4329-b698-d38eb04d4cae" released by "delete_volume" :: held 0.684s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Created reservations ['9b1c74e9-044b-4cac-93eb-378184d7b918', '462c0acb-2d42-421d-b3b8-f7e47d327171', '375a2527-5b4d-466b-8c06-816d403e76cb', '8576f454-8761-46f7-a0eb-3bbfef483eee'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:36 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:36 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:36 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.261s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:36 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:32:36 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-8c98ca83-f35e-4248-9204-c130e847fd8d tempest-ProjectMemberTests-884815338 None] Lock "cinder-f38c3b73-7a88-4329-b698-d38eb04d4cae-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (5cbcf605-0726-45b4-8469-d3f181dab5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf979d6-15a1-4283-8058-fd7a082dda50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf979d6-15a1-4283-8058-fd7a082dda50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409024947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60dcc24b-9fe8-4e1a-a8a4-771f547f6edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:37Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e39136d-3d9b-4aef-a273-8a2fab77f3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e39136d-3d9b-4aef-a273-8a2fab77f3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fec21f7-2ecb-41b1-add4-ec830e9e417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fec21f7-2ecb-41b1-add4-ec830e9e417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60dcc24b-9fe8-4e1a-a8a4-771f547f6edf', 'volume_name': 'volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e5f5ab-fa64-4d62-868e-e7aa2095f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e5f5ab-fa64-4d62-868e-e7aa2095f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2484d3-5110-48e9-bd54-be8a7b8a92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:37 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Volume 60dcc24b-9fe8-4e1a-a8a4-771f547f6edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf', 'volume_size': 1} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409024947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60dcc24b-9fe8-4e1a-a8a4-771f547f6edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:37Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Creating volume 60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:37 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:37 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf 1073741824 Sep 28 18:32:37 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:37 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf 1073741824" returned: 0 in 0.432s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:37 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:37 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf Sep 28 18:32:37 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:38 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" returned: 0 in 0.249s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2484d3-5110-48e9-bd54-be8a7b8a92e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da27970-8d77-4a6b-833a-d23b97f6f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:38 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Volume volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf (60dcc24b-9fe8-4e1a-a8a4-771f547f6edf): created successfully Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da27970-8d77-4a6b-833a-d23b97f6f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (5cbcf605-0726-45b4-8469-d3f181dab5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:38 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-05a0074d-0c6b-43ed-8a05-0db4a963f9ee tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Creating offline snapshot 5a5b9586-2454-4090-8488-9947dcf6e85f of volume 60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00a3a5-a911-41c8-8e64-29fdb8ef327e]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:38 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf Sep 28 18:32:38 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:38 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" returned: 0 in 0.380s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:38 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f 1G Sep 28 18:32:38 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:38 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:38 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:39 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.275s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:32:39 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f 1G" returned: 0 in 0.474s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:39 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f Sep 28 18:32:39 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:39 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f" returned: 0 in 0.304s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:39 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f is being set with open permissions: ugo+rw Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:39 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f Sep 28 18:32:39 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:39 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f" returned: 0 in 0.255s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:39 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.info Sep 28 18:32:39 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:40 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.info" returned: 0 in 0.252s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:40 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.info is being set with open permissions: ugo+rw Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:40 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.info Sep 28 18:32:40 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:40 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.info" returned: 0 in 0.247s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:40 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-eb87b7a4-82ab-4fc4-a586-47a554c20e36 tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-5a5b9586-2454-4090-8488-9947dcf6e85f-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Lock "cinder-5a5b9586-2454-4090-8488-9947dcf6e85f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-5a5b9586-2454-4090-8488-9947dcf6e85f" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-5a5b9586-2454-4090-8488-9947dcf6e85f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot 5a5b9586-2454-4090-8488-9947dcf6e85f of volume 60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[062a6a0a-ca88-4590-a8ef-cd25ae2372a1]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:40 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f Sep 28 18:32:40 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:40 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f" returned: 0 in 0.358s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee98a475-9008-4d4d-9693-d9f7871419ac]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:40 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:41 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf Sep 28 18:32:41 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:41 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" returned: 0 in 0.379s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:41 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f Sep 28 18:32:41 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:41 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f" returned: 0 in 0.364s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:41 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f Sep 28 18:32:41 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:41 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:41 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf.5a5b9586-2454-4090-8488-9947dcf6e85f" returned: 0 in 0.244s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-5a5b9586-2454-4090-8488-9947dcf6e85f" released by "_delete_snapshot" :: held 1.449s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" released by "delete_snapshot" :: held 1.470s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Created reservations ['3f868e50-d376-4ae1-8f17-580e63273087', '66434e1a-357a-45ce-b6b9-9146c45f4259', 'b1a055b2-4d00-42a1-9d1f-c3a3a4af2363', '0dba2271-741e-432e-ac62-71ffd1e2c97b'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:42 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2b4f9106-2626-4cd5-8432-8325909cbe8e tempest-ProjectMemberTests-884815338 None] Lock "cinder-5a5b9586-2454-4090-8488-9947dcf6e85f-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Lock "cinder-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" acquired by "delete_volume" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[a333f625-f7f5-4bce-b78e-9b037aadf175]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:42 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:42 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf Sep 28 18:32:42 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:43 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" returned: 0 in 0.413s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:43 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf Sep 28 18:32:43 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:43 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" returned: 0 in 0.267s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf" released by "delete_volume" :: held 0.742s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Created reservations ['06617cce-edf1-488a-b5af-c6fb50c6d9ef', 'a2555add-05d6-4a8a-b674-a061d71caeac', '0bc3d6a4-cde7-4f8e-9258-0eb43f48674e', 'fb23b725-059d-46a2-8cd0-0d26520e1d28'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:43 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:43 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:43 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.285s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:43 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:32:43 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-2c34a25c-4c60-4469-a8d2-613dc502a58b tempest-ProjectMemberTests-884815338 None] Lock "cinder-60dcc24b-9fe8-4e1a-a8a4-771f547f6edf-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (1831fbd3-bb7a-44db-9be8-a62b28526037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b8adf3-ba77-4ee9-a930-6bbc2aa5eee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b8adf3-ba77-4ee9-a930-6bbc2aa5eee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1450861269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7563bcf9-813a-4414-a2a9-dd0b6e3169c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:44Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc7355a-539b-4180-984f-629117eebca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc7355a-539b-4180-984f-629117eebca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82899656-c1d5-449c-8384-07cf8b74fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82899656-c1d5-449c-8384-07cf8b74fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7563bcf9-813a-4414-a2a9-dd0b6e3169c8', 'volume_name': 'volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4317e984-f3e8-438d-ab39-ba18ca1e8365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4317e984-f3e8-438d-ab39-ba18ca1e8365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7297f8-bae3-41fd-9106-0e8b1289fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:44 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Volume 7563bcf9-813a-4414-a2a9-dd0b6e3169c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8', 'volume_size': 1} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1450861269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7563bcf9-813a-4414-a2a9-dd0b6e3169c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:44Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Creating volume 7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:44 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:44 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 1073741824 Sep 28 18:32:44 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:44 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 1073741824" returned: 0 in 0.473s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:44 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:45 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 Sep 28 18:32:45 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:45 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" returned: 0 in 0.273s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:45 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:45 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7297f8-bae3-41fd-9106-0e8b1289fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa45e7b-9b5b-41f2-92aa-40b17717a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:45 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Volume volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 (7563bcf9-813a-4414-a2a9-dd0b6e3169c8): created successfully Sep 28 18:32:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa45e7b-9b5b-41f2-92aa-40b17717a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:45 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (1831fbd3-bb7a-44db-9be8-a62b28526037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:45 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-5113b0c2-73e2-4e6f-a2e2-c1cda914bbe2 tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:32:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:46 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Creating offline snapshot ecda8505-59dd-425e-992a-20cc89c281a6 of volume 7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:46 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d015e0c-7074-410e-8001-cb81de98171d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:46 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 Sep 28 18:32:46 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:46 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" returned: 0 in 0.377s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:46 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:47 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 1G Sep 28 18:32:47 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:47 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 1G" returned: 0 in 0.431s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:47 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 Sep 28 18:32:47 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:47 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6" returned: 0 in 0.298s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:47 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 is being set with open permissions: ugo+rw Sep 28 18:32:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:47 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 Sep 28 18:32:47 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:47 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6" returned: 0 in 0.244s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:47 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:48 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.info Sep 28 18:32:48 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:48 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.info" returned: 0 in 0.260s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:48 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.info is being set with open permissions: ugo+rw Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:48 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.info Sep 28 18:32:48 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:48 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.info" returned: 0 in 0.268s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:48 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-3c42d645-0b57-4832-92fb-37dfd9671962 tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-ecda8505-59dd-425e-992a-20cc89c281a6-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Lock "cinder-ecda8505-59dd-425e-992a-20cc89c281a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-ecda8505-59dd-425e-992a-20cc89c281a6" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ecda8505-59dd-425e-992a-20cc89c281a6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot ecda8505-59dd-425e-992a-20cc89c281a6 of volume 7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee212ae6-1fd3-43bc-a174-932d954ba6fe]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:48 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 Sep 28 18:32:48 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:49 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6" returned: 0 in 0.411s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e88404-0fec-48d0-8f88-b733b39b4484]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:49 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 Sep 28 18:32:49 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:49 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" returned: 0 in 0.360s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:49 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 Sep 28 18:32:49 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:49 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6" returned: 0 in 0.363s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:49 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:49 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6 Sep 28 18:32:49 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:50 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8.ecda8505-59dd-425e-992a-20cc89c281a6" returned: 0 in 0.273s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ecda8505-59dd-425e-992a-20cc89c281a6" released by "_delete_snapshot" :: held 1.520s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" released by "delete_snapshot" :: held 1.543s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Created reservations ['3ca912c5-2529-4d5f-bb0d-f17eb458a035', '8d3e06a9-18e5-4b47-9dc5-c95218ec675b', '573f7fed-ac1a-46a8-80c4-a774f43dd7e1', '28b176f1-b90a-4eb8-87e5-4995975ef3b1'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:50 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-ca780eec-db82-4109-90f3-93dbbecc702c tempest-ProjectMemberTests-884815338 None] Lock "cinder-ecda8505-59dd-425e-992a-20cc89c281a6-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-7563bcf9-813a-4414-a2a9-dd0b6e3169c8-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Lock "cinder-7563bcf9-813a-4414-a2a9-dd0b6e3169c8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" acquired by "delete_volume" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb36c81-d134-45f5-9657-501c0f9b5d3d]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:50 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:51 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 Sep 28 18:32:51 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:51 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" returned: 0 in 0.399s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:51 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8 Sep 28 18:32:51 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:51 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" returned: 0 in 0.259s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-7563bcf9-813a-4414-a2a9-dd0b6e3169c8" released by "delete_volume" :: held 0.723s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Created reservations ['08952ec9-0c64-40c1-8a95-f3d8d107572d', '10418f2e-cfd7-4640-bdc1-a7c4bf8603dc', 'c02c7923-f49b-40e7-b56c-f947a25fcf08', 'b082ca3f-965c-4183-84f4-e100cab33e84'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:51 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:51 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:32:51 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:52 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.284s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:52 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-dcc3e4a8-d0a0-477c-9ac7-ad2a4efe7a57 tempest-ProjectMemberTests-884815338 None] Lock "cinder-7563bcf9-813a-4414-a2a9-dd0b6e3169c8-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (5e15e7bd-5f5f-40c6-8b1d-4285c4aa73b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ec9752-496a-4b2e-b33f-90e9a1db243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ec9752-496a-4b2e-b33f-90e9a1db243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591945535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65442bd-5c81-44c4-af55-abd6c706a764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:52Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04506cb-553a-4fb4-8783-74b470f25c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04506cb-553a-4fb4-8783-74b470f25c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a017313e-35f3-4f15-8a4b-657d190856cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a017313e-35f3-4f15-8a4b-657d190856cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65442bd-5c81-44c4-af55-abd6c706a764', 'volume_name': 'volume-b65442bd-5c81-44c4-af55-abd6c706a764', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fdd358-278c-414e-8ae2-948c4fee95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fdd358-278c-414e-8ae2-948c4fee95bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6e1c1c-1465-4888-9f46-a68af2ca7df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:52 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Volume b65442bd-5c81-44c4-af55-abd6c706a764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65442bd-5c81-44c4-af55-abd6c706a764', 'volume_size': 1} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591945535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65442bd-5c81-44c4-af55-abd6c706a764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:32:52Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Creating volume b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:32:52 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:32:52 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:52 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 1073741824 Sep 28 18:32:52 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:53 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 1073741824" returned: 0 in 0.432s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:53 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 Sep 28 18:32:53 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:53 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764" returned: 0 in 0.259s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6e1c1c-1465-4888-9f46-a68af2ca7df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65442bd-5c81-44c4-af55-abd6c706a764', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a26e912-c929-4649-93df-7a4e99132b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:32:53 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Volume volume-b65442bd-5c81-44c4-af55-abd6c706a764 (b65442bd-5c81-44c4-af55-abd6c706a764): created successfully Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a26e912-c929-4649-93df-7a4e99132b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (5e15e7bd-5f5f-40c6-8b1d-4285c4aa73b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:32:53 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d5472670-e45b-45f7-8e25-ba5fee38356c tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Creating offline snapshot ed5886dc-a432-4f31-ab90-ff1217750d7f of volume b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dee3209-0696-469a-a17d-e8a1763c7fd0]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:53 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:53 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 Sep 28 18:32:53 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:54 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764" returned: 0 in 0.368s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:54 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f 1G Sep 28 18:32:54 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:54 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f 1G" returned: 0 in 0.417s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65442bd-5c81-44c4-af55-abd6c706a764 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:54 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65442bd-5c81-44c4-af55-abd6c706a764 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f Sep 28 18:32:54 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:54 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65442bd-5c81-44c4-af55-abd6c706a764 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f" returned: 0 in 0.280s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:54 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f is being set with open permissions: ugo+rw Sep 28 18:32:54 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:54 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f Sep 28 18:32:54 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:55 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f" returned: 0 in 0.240s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:55 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.info Sep 28 18:32:55 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:55 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.info" returned: 0 in 0.264s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:55 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.info is being set with open permissions: ugo+rw Sep 28 18:32:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:55 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.info Sep 28 18:32:55 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:55 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.info" returned: 0 in 0.248s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:55 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:55 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-d6aafb14-c72d-4e00-b88e-0ad22293c418 tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-ed5886dc-a432-4f31-ab90-ff1217750d7f-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Lock "cinder-ed5886dc-a432-4f31-ab90-ff1217750d7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-b65442bd-5c81-44c4-af55-abd6c706a764" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-b65442bd-5c81-44c4-af55-abd6c706a764" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-ed5886dc-a432-4f31-ab90-ff1217750d7f" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ed5886dc-a432-4f31-ab90-ff1217750d7f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot ed5886dc-a432-4f31-ab90-ff1217750d7f of volume b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd9401d-4593-497f-8ef8-5e8deafe1f10]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:58 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:58 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f Sep 28 18:32:58 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:59 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f" returned: 0 in 0.389s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b65442bd-5c81-44c4-af55-abd6c706a764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[335626bc-0da1-43f6-b2b7-243dd70bb459]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:59 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 Sep 28 18:32:59 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:59 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764" returned: 0 in 0.383s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:59 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f Sep 28 18:32:59 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:59 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f" returned: 0 in 0.338s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:59 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:59 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f Sep 28 18:32:59 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:00 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:00 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764.ed5886dc-a432-4f31-ab90-ff1217750d7f" returned: 0 in 0.246s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ed5886dc-a432-4f31-ab90-ff1217750d7f" released by "_delete_snapshot" :: held 1.458s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-b65442bd-5c81-44c4-af55-abd6c706a764" released by "delete_snapshot" :: held 1.484s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:00 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Created reservations ['00c20df1-a023-42cc-8bb8-0ad76669c842', 'b4574a08-6a51-41cb-8eb2-3ce747aa2f9f', 'ddfcec74-a24e-4190-a972-a4cfae538805', '8468978b-bb79-48b7-94f0-6a2e36fd2629'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:33:00 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:33:00 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-478f9aab-50b2-46b5-968f-3ddb02afaf89 tempest-ProjectMemberTests-884815338 None] Lock "cinder-ed5886dc-a432-4f31-ab90-ff1217750d7f-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-b65442bd-5c81-44c4-af55-abd6c706a764-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:33:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Lock "cinder-b65442bd-5c81-44c4-af55-abd6c706a764-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:33:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-b65442bd-5c81-44c4-af55-abd6c706a764" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:33:01 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-b65442bd-5c81-44c4-af55-abd6c706a764" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:33:01 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20de87c-8775-4762-ba22-d7aa5b695f2b]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:33:01 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:01 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 Sep 28 18:33:01 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:02 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764" returned: 0 in 0.389s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:02 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764 Sep 28 18:33:02 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:02 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-b65442bd-5c81-44c4-af55-abd6c706a764" returned: 0 in 0.252s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-b65442bd-5c81-44c4-af55-abd6c706a764" released by "delete_volume" :: held 0.706s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Created reservations ['2b4651e9-9f15-4404-8b05-54dd4f92120a', '3312775a-6961-432b-a1aa-a37b8289ee3a', '32110834-ad2b-40c6-ab50-26405e8e99fc', 'b19dfa00-44ff-477b-b688-26cc7cd6ac90'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:02 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:33:02 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:02 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.274s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:33:02 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:33:02 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-05e34c8a-cf2f-4b3e-a47d-59cfce8fa171 tempest-ProjectMemberTests-884815338 None] Lock "cinder-b65442bd-5c81-44c4-af55-abd6c706a764-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.flows.manager.create_volume [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86981) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (a191ad1c-e576-4485-aaff-42af8fd29cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd3242e-517b-4c6c-9688-6815b19c9ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd3242e-517b-4c6c-9688-6815b19c9ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510361061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:33:03Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1618ac-baaa-4f0d-8e68-874994c62036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1618ac-baaa-4f0d-8e68-874994c62036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51ad278-7cc8-4709-8ee3-8aa537d38d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51ad278-7cc8-4709-8ee3-8aa537d38d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8', 'volume_name': 'volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a30a95-7d4c-410f-9aac-1e29b14358b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a30a95-7d4c-410f-9aac-1e29b14358b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33ddc93-234b-4aef-8f73-3ec7adcfe3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:03 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Volume ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8', 'volume_size': 1} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510361061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7cca45465044849edd68342dbd5646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:33:03Z,use_quota=True,user_id='8ffe7eba1fbe4e3cbae0f4b0e8c83703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55),volume_type_id=dc0e54b2-1eda-4b8c-8bef-fc33a8e97a55)}" {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Creating volume ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Selected osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef as target Quobyte volume. {{(pid=86981) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:33:03 devstack cinder-volume[86981]: INFO cinder.volume.drivers.remotefs [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] casted to osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 1073741824 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:03 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 1073741824 Sep 28 18:33:03 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:03 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 1073741824" returned: 0 in 0.463s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:03 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:03 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 Sep 28 18:33:03 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:04 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" returned: 0 in 0.248s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'} {{(pid=86981) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=168,cinder:DELETE=13,cinder:SELECT=131,cinder:INSERT=50 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33ddc93-234b-4aef-8f73-3ec7adcfe3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8', 'volume_size': 1}' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e80e4a4-af89-40a7-a21e-9166c20565ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:33:04 devstack cinder-volume[86981]: INFO cinder.volume.flows.manager.create_volume [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Volume volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 (ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8): created successfully Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e80e4a4-af89-40a7-a21e-9166c20565ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86981) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Flow 'volume_create_manager' (a191ad1c-e576-4485-aaff-42af8fd29cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86981) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:33:04 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-8891920d-04eb-4735-be89-dd46660f7b6d tempest-ProjectMemberTests-884815338 None] Created volume successfully. Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=163,cinder:SELECT=119,cinder:DELETE=15,cinder:INSERT=39 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Creating offline snapshot 579471aa-1af9-4819-930f-28012762842d of volume ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be0ffc-c9c2-48ca-9310-e2c18bb7d215]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:04 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 Sep 28 18:33:04 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:04 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" returned: 0 in 0.359s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:04 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d 1G {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:04 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d 1G Sep 28 18:33:04 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:05 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d 1G" returned: 0 in 0.387s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:05 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d Sep 28 18:33:05 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:05 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 -F qcow2 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d" returned: 0 in 0.278s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:05 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d is being set with open permissions: ugo+rw Sep 28 18:33:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:05 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d Sep 28 18:33:05 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:05 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d" returned: 0 in 0.237s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:05 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:05 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.info Sep 28 18:33:05 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:06 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.info" returned: 0 in 0.237s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:06 devstack cinder-volume[86981]: WARNING cinder.volume.drivers.remotefs [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.info is being set with open permissions: ugo+rw Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.info {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:06 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.info Sep 28 18:33:06 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:06 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.info" returned: 0 in 0.251s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:06 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-dd31e776-7a52-41eb-89c4-ce7893738ce4 tempest-ProjectMemberTests-884815338 None] Create snapshot completed successfully Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-579471aa-1af9-4819-930f-28012762842d-delete_snapshot" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Lock "cinder-579471aa-1af9-4819-930f-28012762842d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" by "delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-579471aa-1af9-4819-930f-28012762842d" by "_delete_snapshot" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-579471aa-1af9-4819-930f-28012762842d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Deleting offline snapshot 579471aa-1af9-4819-930f-28012762842d of volume ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] snapshot_file for this snap is: volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d {{(pid=86981) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[af98c010-f659-4122-938d-6321b331807a]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:33:06 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:06 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d Sep 28 18:33:06 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:07 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d" returned: 0 in 0.363s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:07 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.remotefs [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86981) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:33:07 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b3b9e9-97cf-44ab-b42a-3fbb0a160def]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:33:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:07 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 Sep 28 18:33:07 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:07 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" returned: 0 in 0.354s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:07 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:07 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d Sep 28 18:33:07 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:07 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d" returned: 0 in 0.367s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:08 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d Sep 28 18:33:08 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:08 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8.579471aa-1af9-4819-930f-28012762842d" returned: 0 in 0.297s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-579471aa-1af9-4819-930f-28012762842d" released by "_delete_snapshot" :: held 1.482s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" released by "delete_snapshot" :: held 1.506s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Created reservations ['560634de-0d69-41fa-9669-4e98d6d6d906', 'b91ce001-0cb9-45ad-8e9e-fdf6fab59d5b', '52989bd1-061f-4331-a1ac-dfd8fe555335', 'd634289e-f7ae-40e3-8aa6-2daf58a52fb1'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:33:08 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Delete snapshot completed successfully. Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-13fe6ce8-d54c-414c-ba9f-aba61d609df4 tempest-ProjectMemberTests-884815338 None] Lock "cinder-579471aa-1af9-4819-930f-28012762842d-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:08 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8-delete_volume" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Lock "cinder-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Acquiring lock "cinder-quobyte-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" by "delete_volume" {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" acquired by "delete_volume" :: waited 0.017s {{(pid=86981) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo.privsep.daemon [-] privsep: reply[636b89eb-5c42-40af-bc2a-ea02613a3341]: (4, 'qcow2') {{(pid=88001) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:09 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 Sep 28 18:33:09 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:09 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" returned: 0 in 0.429s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:09 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8 Sep 28 18:33:09 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:09 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089/volume-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" returned: 0 in 0.285s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Lock "cinder-quobyte-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8" released by "delete_volume" :: held 0.787s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG cinder.quota [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Created reservations ['ad0104a7-8ffa-4677-8719-cdc8baa0fe31', '89ecf4b7-cebb-4634-ac09-020ca16e2e1d', '6e1be66c-4701-4935-a296-efdb5d6b39ff', '2b683b0a-8009-4c8b-9e81-c803845f6586'] {{(pid=86981) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:33:09 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:10 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:33:10 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:10 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:10 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.313s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:10 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:33:10 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Deleted volume successfully. Sep 28 18:33:10 devstack cinder-volume[86981]: DEBUG cinder.coordination [None req-511bd0db-ebd5-4366-81bd-467c2cf63e1c tempest-ProjectMemberTests-884815338 None] Lock "cinder-ee3f5e31-cd6f-4942-88ff-c2958c7b6ad8-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86981) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:33:19 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:33:20 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:UPDATE=15,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:33:38 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:33:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:33:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:33:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef': None} {{(pid=86981) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:33:38 devstack cinder-volume[86981]: DEBUG cinder.volume.drivers.quobyte [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46ad5c7a-4244-4e8f-813b-b774e53289ef'] {{(pid=86981) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:33:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86981) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:33:38 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:33:38 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089 Sep 28 18:33:38 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:33:39 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 28 18:33:39 devstack cinder-volume[86981]: DEBUG oslo_concurrency.processutils [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a0662b948ca8ed392e6d42c0062d089" returned: 0 in 0.234s {{(pid=86981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:33:39 devstack cinder-volume[86981]: DEBUG cinder.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Notifying Schedulers of capabilities ... {{(pid=86981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:33:39 devstack cinder-volume[86981]: DEBUG oslo_service.periodic_task [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] Running periodic task VolumeManager._thread_info {{(pid=86981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:33:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread count: 28 {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:33:39 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-a3806f62-1390-4869-9d6d-04f27bac4bbb None None] thread info: [<_MainThread(MainThread, started 136303719125120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}